-- Logs begin at Wed 2022-11-02 11:56:35 UTC, end at Wed 2022-11-02 13:19:01 UTC. -- Nov 02 12:43:31.148152 dv-cinder-863278-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:43:31.157664 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:43:31 2022] *** Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: nodename: dv-cinder-863278-1-iscsi Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: machine: x86_64 Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: clock source: unix Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: pcre jit disabled Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: detected number of CPU cores: 4 Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: current working directory: / Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: your processes number limit is 47680 Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: your memory page size is 4096 bytes Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: detected max file descriptor number: 2048 Nov 02 12:43:31.159657 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: lock engine: pthread robust mutexes Nov 02 12:43:31.160525 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: thunder lock: enabled Nov 02 12:43:31.160525 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:43:31.160525 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:43:31.208365 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: Python main interpreter initialized at 0x564fb3f739c0 Nov 02 12:43:31.208365 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: python threads support enabled Nov 02 12:43:31.208365 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: your server socket listen backlog is limited to 100 connections Nov 02 12:43:31.208365 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:43:31.208765 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:43:31.208765 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: *** Operational MODE: preforking *** Nov 02 12:43:31.208990 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:43:31.208990 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: spawned uWSGI master process (pid: 109726) Nov 02 12:43:31.209262 dv-cinder-863278-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:43:31.209912 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: spawned uWSGI worker 1 (pid: 109727, cores: 1) Nov 02 12:43:31.210020 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: spawned uWSGI worker 2 (pid: 109728, cores: 1) Nov 02 12:43:31.210254 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:43:32.387971 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:43:32.389545 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:43:33.267908 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:43:33.267908 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: from cryptography.utils import int_from_bytes Nov 02 12:43:33.268280 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:43:33.268280 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: from cryptography.utils import int_from_bytes Nov 02 12:43:33.269068 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:43:33.269068 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: from cryptography.utils import int_from_bytes Nov 02 12:43:33.269404 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:43:33.269404 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: from cryptography.utils import int_from_bytes Nov 02 12:43:35.790931 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:43:35.791476 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:43:35.791476 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:43:35.791904 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:43:35.791982 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:43:35.792059 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:43:35.792059 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:43:35.792194 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:43:35.792308 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:43:35.792383 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:43:35.792583 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.792669 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.792963 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.793183 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.793311 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.793413 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.793671 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.793809 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.793961 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.794062 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.794284 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.794405 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.794590 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.794700 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.794935 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.795085 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.795269 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.795408 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.795494 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.795588 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.795821 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.795975 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.796147 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863278-1-iscsi {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.796297 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863278-1-iscsi {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.796491 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.796662 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.796807 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.796891 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.797167 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.797302 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.797480 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.797590 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.797805 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.797942 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.798126 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.798253 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.798383 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.798464 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.798889 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.799293 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.799293 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.799539 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.799646 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.799746 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.799914 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.800032 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.800274 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.800465 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.800589 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.800695 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.800874 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.800963 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.801187 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.801285 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.801494 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.801580 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.801795 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.801922 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.802106 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.802218 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.802504 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863278-1-iscsi {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.802616 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863278-1-iscsi {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.802829 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.802950 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.803136 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.803222 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.803433 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.803539 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.803839 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.803965 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.804152 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.804278 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.804484 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.804581 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.804799 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.804889 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.805119 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.805208 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.805430 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.805527 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.805765 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.805927 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.806083 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.806190 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.806401 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.806495 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.806723 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.806821 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.807023 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.807107 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.807329 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.807412 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.807634 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.807724 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.807957 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.808040 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.808277 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.808377 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.808623 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.808736 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.808837 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.808958 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.809143 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.809269 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.809463 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.809592 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.809782 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.809914 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.810103 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.810237 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.810337 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.810490 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.810574 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.810741 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.810892 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.811059 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.811213 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.811381 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.811519 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.811685 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.811824 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.812003 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.812115 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.812331 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.812448 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.812661 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.812780 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.812968 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.813084 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.813272 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.813386 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.813574 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.813692 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.813880 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.814007 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.814198 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.814318 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.814512 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.814638 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.814831 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.814945 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.815137 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.815263 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.815454 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.815659 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.815852 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.815937 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.816102 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.816187 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.816432 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.816538 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.816772 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.816856 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.817092 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.817187 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.817400 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.817484 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.817721 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.817814 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.818038 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.818128 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.818343 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.818433 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.818651 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.818742 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.818964 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.819060 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.819280 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.819365 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.819581 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.819673 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.819832 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.819915 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.820129 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.820254 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.820454 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.820543 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.820758 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.820850 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.821060 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.821158 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.821366 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.821449 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.821669 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.821767 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.821969 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.822064 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.822267 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.822355 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.822569 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.822663 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.822869 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.822951 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.823169 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.823256 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.823473 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.823571 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.823778 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.823866 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.824082 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.824248 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.824396 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.824559 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.824696 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.824872 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.825013 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.825170 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.825335 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.825492 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.825647 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.825822 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.825947 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.826124 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.826247 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.826430 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.826549 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.826736 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.826866 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.827039 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.827168 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.827363 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.827474 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.827668 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.827796 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.827973 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.828091 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.828356 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.828451 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.828765 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.828848 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.829071 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.829163 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.829374 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.829497 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.829680 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.829763 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.829980 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.830076 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.830284 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.830368 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.830581 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.830663 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.830885 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.830976 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.831185 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.831268 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.831485 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.831568 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.831784 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.831876 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.832082 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.832164 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.832405 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.832490 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.832704 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.832788 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.832998 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.833083 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.833294 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.833376 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.833593 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.833684 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.833888 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.833971 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.834200 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.834290 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.834504 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.834588 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.834810 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.834893 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.835112 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.835193 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.835416 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.835507 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.835731 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:43:35.835814 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.836065 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.836156 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.836418 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.836501 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.836750 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.836846 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.837062 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.837152 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.837383 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.837466 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.837696 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.837779 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.838016 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.838122 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.838322 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.838404 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.838635 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.838717 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.838945 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.839071 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.839254 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.839337 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.839563 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.839644 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.839875 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.839959 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.840192 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.840363 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.840532 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.840634 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.840839 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.840931 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.841155 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.841239 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.841464 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.841546 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.841961 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.842074 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.842074 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.842224 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.842407 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.842623 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.842715 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.843399 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.843485 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.843569 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.843646 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.843722 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.843806 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.844012 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.844111 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.844383 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.844484 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.844691 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.844783 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.844999 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.845083 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.845306 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.845390 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.845616 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.845707 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.845924 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.846015 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.846233 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.846317 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.846546 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.846629 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.846854 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.846945 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.847163 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.847253 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.847471 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.847556 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.847780 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.847863 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.848091 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.848186 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.848422 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.848508 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.848734 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.848817 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.849041 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.849147 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.849348 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.849431 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.849660 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.849744 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.849968 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.850063 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.850274 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.850365 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.850579 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.850658 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.850880 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.851050 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.851181 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.851272 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.851482 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.851571 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.851787 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.851879 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.852087 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.852177 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.852413 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.852544 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.852720 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.852816 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.853024 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.853107 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.853341 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.853424 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.853642 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.853726 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.853949 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.854033 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.854254 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.854344 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.854559 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.854643 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.854860 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.854943 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.855164 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.855245 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.855473 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.855626 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.855776 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.855934 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.856096 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.856265 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.856427 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.856576 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.856727 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.856880 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.857045 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.857203 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.857344 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.857514 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.857652 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.857816 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.857943 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.858133 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.858273 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.858434 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.858560 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.858734 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.858872 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.859057 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.859467 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.859602 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.859733 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.859870 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860001 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860144 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860321 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860464 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860594 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860722 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860869 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.860997 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.861127 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.861263 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.861392 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.861529 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.861690 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.861843 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.862004 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.862137 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.862305 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.862454 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.862613 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.862761 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.862915 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.863078 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.863212 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.863379 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.863517 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.863686 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.863811 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.863989 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.864126 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.864317 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.864453 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.864618 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.864754 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.864925 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.865055 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.865226 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.865354 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.865531 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.865671 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.865834 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.865962 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.866131 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.866286 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.866419 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.866560 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.866719 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.866856 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.867027 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.867157 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.867329 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.867456 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.867632 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.867768 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.867931 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.868064 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.868299 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.868389 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.868604 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.868696 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.868925 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.869008 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.869240 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.869324 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.869549 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.869641 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.869857 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.869940 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.870162 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.870271 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.870468 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.870560 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.870773 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.870856 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.871084 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.871295 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.871402 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.871564 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.871688 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.871873 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.872009 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.872193 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.872345 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.872522 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.872649 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.872835 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.872949 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.873144 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.873266 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.873465 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.873601 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.873773 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.873930 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.874089 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.874240 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.874391 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.874557 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.874703 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.874862 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.875039 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.875223 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.875416 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.875530 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.875732 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.875859 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.876051 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.876136 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.876382 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.876485 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.876695 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.876791 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.877001 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.877086 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.877306 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.877396 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.877611 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.877694 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.877917 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.878001 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.878224 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.878321 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.878527 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.878613 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.878823 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.878913 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.879130 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.879213 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.879451 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.879609 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.879748 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.879838 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.880060 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.880143 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.880383 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.880477 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.880691 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.880775 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.881001 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.881083 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.881309 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.881403 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.881619 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.881702 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.881921 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.882004 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.882228 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.882323 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.882534 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.882615 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.882839 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.882920 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.883147 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.883238 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.883448 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.883531 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.883745 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.883826 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.884048 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.884132 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.884376 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.884471 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.884682 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.884766 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.884986 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.885068 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.885288 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.885377 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.885600 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.885683 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.885903 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.885986 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.886204 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.886330 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.886506 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.886615 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.886886 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.887003 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.887170 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.887297 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.887423 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.887631 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.887778 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.887930 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.888022 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.888270 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.888361 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.888580 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.888676 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.888882 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.888966 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.889204 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.889289 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.889513 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.889603 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.889815 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.889905 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.890122 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.890232 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.890428 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.890514 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.890760 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.890842 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.891069 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.891160 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.891384 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.891475 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.891695 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.891784 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.892005 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.892096 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.892333 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.892419 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.892648 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.892729 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.892953 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.893048 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.893257 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.893338 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.893565 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.893648 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.893873 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.893964 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.894179 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.894270 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.894485 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.894566 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.894790 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.894873 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.895087 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.895212 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.895391 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.895473 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.895712 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.895796 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.896019 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.896315 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.896414 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.896643 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.896735 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.896943 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.897025 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.897250 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.897332 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.897561 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.897653 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.897916 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.898125 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.898209 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.898455 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.898547 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.898772 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.898865 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.899088 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.899180 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.899409 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.899491 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.899716 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.899799 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.900366 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.900461 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.900671 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.900814 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.900972 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.901057 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.901276 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.901368 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.901579 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.901664 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.901883 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.901981 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.902184 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.902274 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.902486 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.902650 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.902785 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.902958 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.903095 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.903263 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.903383 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.903567 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.903685 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.903874 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.903993 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.904179 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.904322 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.904506 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.904641 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.904812 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.904944 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.905115 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.905245 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.905427 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.905547 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.905728 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.905847 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.906040 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.906279 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.906439 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.906638 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.906740 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.906976 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.907067 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.907283 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.907373 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.907587 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.907671 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.907888 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.907970 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.908230 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.908327 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.908537 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.908619 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.908852 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.908933 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.909155 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.909246 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.909456 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.909539 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.909761 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.909848 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.910069 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.910161 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.910372 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.910483 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.910684 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.910777 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.910982 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.911086 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.911284 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.911374 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.911587 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.911678 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.911884 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.911976 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.912181 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.912300 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.912507 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.912589 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.912810 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.912895 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.913114 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.913208 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.913412 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.913495 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.913709 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.913794 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914008 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914090 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914306 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914389 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914602 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914686 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914904 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.914986 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.915199 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.915289 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.915498 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.915582 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.915794 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.915884 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.916090 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.916227 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.916418 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.916502 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.916721 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.916815 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.917021 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.917118 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.917318 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.917399 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.917620 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.917702 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.917965 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.918066 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.918232 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.918380 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.918531 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.918733 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.918839 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.919052 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.919146 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.919351 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.919442 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.919670 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.919772 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.919977 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.920064 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.920297 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.920384 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.920601 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.920704 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.920910 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.920992 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.921206 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.921288 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.921506 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.921597 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.921805 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.921888 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.922132 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.922215 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.922431 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.922547 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.922730 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.922822 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.923030 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.923121 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.923333 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.923425 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.923633 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.923717 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.923953 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.924037 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.924281 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.924366 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.924582 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.924667 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.924883 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.924982 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.925178 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.925262 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.925477 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.925559 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.925778 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.925879 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.926106 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.926190 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.926413 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.926504 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.926712 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.926805 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.927015 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.927096 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.927314 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.927411 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.927622 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.927718 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.927936 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.928026 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.928257 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.928344 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.928571 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.928675 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.928878 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.928962 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.929188 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.929283 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.929487 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.929589 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.929787 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.929877 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.930091 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.930174 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.930392 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.930476 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.930695 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.930777 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.930998 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.931079 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.931312 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.931404 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.931611 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.931694 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.931912 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.931996 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.932224 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.932310 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.932541 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.932634 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.932850 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.932933 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.933157 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.933248 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.933466 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.933667 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.933761 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.934061 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.934158 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.934366 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.934457 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.934673 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.934758 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.934984 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.935074 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.935285 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.935376 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.935587 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.935676 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.935888 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.935971 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.936185 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.936288 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.936521 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.936612 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.936825 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.936909 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.937123 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.937206 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.937426 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.937519 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.937779 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.937861 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.938086 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.938170 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.938399 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.938492 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.938689 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.938835 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.939009 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.939142 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.939314 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.939448 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.939612 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.939750 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.939917 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.940054 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.940250 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.940391 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.940554 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.940712 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.940856 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.941020 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.941291 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.941375 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.941595 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.941719 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.941900 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.942027 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.942201 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.942335 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.942512 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.942645 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.942817 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.942957 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.943126 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.943247 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.943433 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.943552 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.943736 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.943873 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.944151 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.944248 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.944483 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.944570 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.944789 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.944885 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.945096 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.945178 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.945395 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.945477 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.945692 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.945789 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.945997 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.946114 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.946317 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.946408 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.946619 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.946720 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.946918 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.947104 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.947217 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.947411 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.947533 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.947719 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.947833 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.948047 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.948153 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.948391 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.948598 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.948711 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.948906 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.949013 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.949203 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.949329 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.949615 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.949708 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.949923 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.950013 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.950231 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.950395 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.950534 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.950631 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.950858 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.950945 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.951136 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.951225 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.951462 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.951544 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.951771 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.951856 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.952075 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.952157 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.952416 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.952511 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.952737 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.952824 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.953046 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.953138 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.953381 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.953475 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.953681 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.953785 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.954001 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.954086 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.954320 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.954413 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.954628 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.954726 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.954934 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.955016 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.955238 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.955331 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.955543 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.955650 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.955863 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.955948 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.956164 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.956368 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.956502 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.956586 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.956808 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.956901 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.957111 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.957195 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.957409 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.957492 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.957709 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.957793 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.958033 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.958118 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.958335 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.958418 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.958637 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.958724 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.958944 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.959029 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.959250 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.959334 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.959555 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.959639 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.959858 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.959959 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.960156 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.960259 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.960493 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.960605 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.960793 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.960876 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.961093 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.961186 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.961393 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.961490 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.961723 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.961814 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.962023 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.962114 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.962327 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.962425 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.962645 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.962770 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.962952 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.963037 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.963249 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.963342 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.963549 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.963629 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.963852 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.963936 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.964186 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.964308 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.964512 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.964594 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.964839 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.965007 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.965138 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.965326 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.965436 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.965653 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.965745 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.965964 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.966065 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.966293 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.966379 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.966607 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.966693 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.966915 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.967041 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.967214 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.967302 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.967517 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.967610 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.967818 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.967904 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.968116 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.968236 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.968449 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.968533 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.968753 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.968858 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.969101 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.969187 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.969405 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.969510 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.969710 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.969803 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.970007 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.970105 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.970309 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.970392 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.970612 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.970704 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.970935 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.971018 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.971238 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.971348 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.971554 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.971638 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.971859 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.971950 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.972158 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.972280 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.972483 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.972567 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.972782 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.972867 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.973095 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.973186 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.973405 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.973494 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.973712 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.973857 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.974021 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.974163 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.974330 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.974468 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.974640 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.974765 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.974944 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.975073 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.975252 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.975376 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.975561 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.975698 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.975869 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.975999 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.976179 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.976406 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.976503 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.976732 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.976825 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.977043 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.977133 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.977350 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.977439 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.977655 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.977748 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.977971 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.978054 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.978278 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.978360 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.978581 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.978665 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.978886 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.979094 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.979186 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.979425 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.979523 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.979742 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.979836 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.980054 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.980179 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.980400 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.980575 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.980703 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.980796 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.981021 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.981112 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.981336 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.981463 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.981646 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.981755 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.981949 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.982034 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.982258 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.982382 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.982582 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.982694 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.982903 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.982996 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.983224 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.983316 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.983556 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.983640 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.983872 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.983982 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.984177 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.984288 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.984529 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.984616 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.984840 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.984936 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.985147 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.985228 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.985453 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.985536 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.985759 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.985844 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.986067 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.986150 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.986375 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.986457 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.986685 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.986770 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.986995 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.987137 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.987301 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.987431 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.987632 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.987765 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.987930 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.988076 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.988256 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.988357 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.988564 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.988796 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.988880 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.989107 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.989199 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.989435 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.989521 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.989765 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.989854 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.990075 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.990159 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.990387 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.990480 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.990699 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.990822 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.991011 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.991105 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.991309 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.991520 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.991616 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.991830 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.991914 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.992161 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.992338 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.992507 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.992590 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.992827 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.992922 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.993134 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.993220 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.993434 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.993517 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.993749 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.993833 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.994048 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.994139 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.994349 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.994572 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.994657 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.994924 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.995009 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.995234 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.995317 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.995554 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.995637 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.995861 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.995986 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.996184 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.996401 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.996489 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.996725 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.997013 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.997119 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.997188 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.997388 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.997547 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.997703 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.997895 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.998019 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.998211 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.998323 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.998537 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.998630 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.998861 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.998945 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.999178 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.999262 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.999483 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.999576 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.999788 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:35.999871 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.000134 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.000265 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.000484 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.000584 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.000788 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.000891 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.001100 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.001229 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.001409 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.001500 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.001691 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.001776 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.001992 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.002075 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.002294 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.002380 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.002597 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.002686 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.002896 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.002980 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.003203 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.003288 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.003506 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.003626 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.003806 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.003900 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.004107 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.004225 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.004430 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.004515 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.004729 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.004811 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.005029 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.005121 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.005331 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.005424 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.005639 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.005732 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.005945 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.006030 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.006257 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.006358 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.006558 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.006650 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.006861 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.006947 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.007163 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.007289 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.007472 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.007607 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.007773 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.007921 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.008081 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.008292 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.008463 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.008610 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.008787 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.009091 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.009177 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.009393 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.009485 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.009708 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.009792 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.010019 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.010160 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.010338 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.010485 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.010651 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.010790 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.010960 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.011092 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.011259 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.011463 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.011592 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.011722 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.011874 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.012182 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.012331 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.012509 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.012654 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.012816 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.012947 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.013123 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.013258 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.013428 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.013566 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.013733 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.013864 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.014038 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.014173 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.014343 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.014486 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.014648 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.014775 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.014951 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.015090 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.015255 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.015386 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.015560 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.015710 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.015893 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.016026 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.016251 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.016342 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.016559 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.016643 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.016866 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.016952 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.017172 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.017264 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.017480 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.017573 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.017782 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.017876 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.018083 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.018174 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.018388 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.018480 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.018690 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.018773 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.018997 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.019079 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.019320 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.019420 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.019631 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.019723 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.019931 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.020014 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.020262 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.020368 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.020579 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.020665 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.020891 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.020975 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.021201 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.021293 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.021508 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.021642 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.021814 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.021899 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.022126 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.022212 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.022452 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.022537 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.022764 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.022862 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.023068 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.023153 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.023395 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.023479 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.023729 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.023821 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.024055 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.024146 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.024399 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.024487 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.024700 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.024794 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.025324 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.025421 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.025625 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.025712 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.025933 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.026031 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.026250 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.026335 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.026554 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.026637 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.026854 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.026950 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.027151 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.027343 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.027461 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.027689 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.027814 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.028014 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.028104 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.028340 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.028443 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.028640 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.028733 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.028940 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.029032 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.029234 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.029318 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.029534 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.029632 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.029831 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.029917 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.030129 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.030228 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.030429 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.030547 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.030724 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.030824 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.031025 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.031108 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.031338 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.031457 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.031670 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.031755 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.031970 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.032059 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.032294 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.032387 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.032592 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.032677 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.032890 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.032972 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.033190 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.033283 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.033490 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.033582 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.033789 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.033882 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.034092 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.034188 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.034397 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.034541 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.034686 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.034831 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.034989 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.035122 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.035291 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.035426 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.035592 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.035732 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.035890 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.036016 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.036247 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.036380 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.036544 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.036684 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.036853 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.036985 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.037160 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.037288 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.037466 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.037625 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.037771 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.037878 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.038078 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.038162 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.038397 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.038481 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.038714 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.038805 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.039015 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.039098 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.039320 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.039413 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.039631 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.039714 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.039941 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.040029 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.040268 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.040359 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.040576 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.040658 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.040890 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.041026 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.041186 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.041271 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.041490 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.041582 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.041801 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.041894 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.042108 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.042192 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.042410 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.042502 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.042724 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.042825 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.043083 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.043183 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.043359 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.043503 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.043680 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.043818 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.044002 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.044124 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.044350 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.044468 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045008 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045093 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045172 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045257 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045338 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045421 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045620 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045706 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.045933 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.046073 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.046238 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.046373 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.046540 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.046671 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.046801 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:43:36.046940 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.047203 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.047528 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.047851 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.048193 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.048521 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.048861 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.049192 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.049505 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.049813 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.050116 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:43:36.050359 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:43:36.071570 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_db.sqlalchemy.engines [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.073647 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_db.sqlalchemy.engines [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.134300 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.context [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df971900-0a53-43b2-b0cc-1fe63c2db549(cell1) {{(pid=109727) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:43:36.135848 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.context [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df971900-0a53-43b2-b0cc-1fe63c2db549(cell1) {{(pid=109728) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:43:36.138614 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_concurrency.lockutils [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:43:36.140008 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:43:36.140176 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_concurrency.lockutils [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:43:36.141017 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_concurrency.lockutils [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:43:36.141647 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:43:36.142448 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:43:36.142937 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_concurrency.lockutils [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:43:36.144411 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:43:36.154736 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_db.sqlalchemy.engines [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.158346 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_db.sqlalchemy.engines [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.161631 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_db.sqlalchemy.engines [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.296298 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_db.sqlalchemy.engines [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.318681 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG oslo_db.sqlalchemy.engines [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.321990 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_db.sqlalchemy.engines [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:43:36.768569 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: WARNING keystonemiddleware.auth_token [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:43:36.771503 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: WARNING keystonemiddleware.auth_token [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:43:36.775519 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: WARNING keystonemiddleware.auth_token [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:43:36.778539 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: WARNING keystonemiddleware.auth_token [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:43:36.992576 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: WARNING keystonemiddleware.auth_token [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:43:36.997241 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: WARNING keystonemiddleware.auth_token [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:43:36.997864 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: WARNING keystonemiddleware.auth_token [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:43:37.002464 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: WARNING keystonemiddleware.auth_token [None req-c834f079-9428-4d42-8db5-789d90cd6945 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:43:37.003255 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564fb3f739c0 pid: 109728 (default app) Nov 02 12:43:37.005347 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:37.006540 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Nov 02 12:43:37.007362 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 788 bytes} [Wed Nov 2 12:43:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:37.007804 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564fb3f739c0 pid: 109727 (default app) Nov 02 12:44:59.481437 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:59.482457 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Nov 02 12:44:59.482862 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 2/2] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:59.904939 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-680e9128-b079-4bb7-9b8f-883d34dc375b admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:59.934514 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-680e9128-b079-4bb7-9b8f-883d34dc375b admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444667 Nov 02 12:44:59.935474 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 1/3] 10.222.0.90 () {60 vars in 1291 bytes} [Wed Nov 2 12:44:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:02.314194 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:02.315879 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-35975c78-22c1-4fc1-a153-aa4f5977d8cb None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Nov 02 12:45:02.316725 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 3/4] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:02.385292 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-e7e35c37-7774-4819-b4af-9ac5edca0a5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "name": "cirros256", "swap": 0, "id": "c1", "rxtx_factor": 1.0, "disk": 1}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:02.404085 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:45:02.404085 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: warnings.warn(msg) Nov 02 12:45:02.434615 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-e7e35c37-7774-4819-b4af-9ac5edca0a5b admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111265 Nov 02 12:45:02.435185 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 2/5] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:02.653791 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-20cd3f74-a6b3-4918-9afe-02fde6e6095c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:02.656419 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:45:02.656419 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: warnings.warn(msg) Nov 02 12:45:02.706696 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-20cd3f74-a6b3-4918-9afe-02fde6e6095c admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262943 Nov 02 12:45:02.707759 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 4/6] 10.222.0.90 () {64 vars in 1335 bytes} [Wed Nov 2 12:45:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:05.083101 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-e7e35c37-7774-4819-b4af-9ac5edca0a5b admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:05.084127 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-e7e35c37-7774-4819-b4af-9ac5edca0a5b admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Nov 02 12:45:05.084624 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 3/7] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:05.192110 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-1ef97064-b900-4495-a941-d41638906eaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "disk": 5}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:05.211237 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:45:05.211237 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: warnings.warn(msg) Nov 02 12:45:05.241705 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-1ef97064-b900-4495-a941-d41638906eaf admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150987 Nov 02 12:45:05.242259 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 5/8] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:05.254645 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-214111f2-7305-45cc-ba88-9d64377bce97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:05.256149 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:45:05.256149 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: warnings.warn(msg) Nov 02 12:45:05.289138 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-214111f2-7305-45cc-ba88-9d64377bce97 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038219 Nov 02 12:45:05.289675 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 4/9] 10.222.0.90 () {64 vars in 1335 bytes} [Wed Nov 2 12:45:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:07.646205 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-1ef97064-b900-4495-a941-d41638906eaf admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:07.647225 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-1ef97064-b900-4495-a941-d41638906eaf admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 02 12:45:07.647629 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 6/10] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:07.709952 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-3e34d70c-98b2-448d-8c3e-6f0f084d7a85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:07.731298 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-3e34d70c-98b2-448d-8c3e-6f0f084d7a85 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077307 Nov 02 12:45:07.738919 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 5/11] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:07.744091 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-4847594f-6e31-453f-b348-6ec7f975c879 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:07.775076 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-4847594f-6e31-453f-b348-6ec7f975c879 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034575 Nov 02 12:45:07.775662 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 7/12] 10.222.0.90 () {64 vars in 1335 bytes} [Wed Nov 2 12:45:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:10.159416 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-3e34d70c-98b2-448d-8c3e-6f0f084d7a85 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:10.160488 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-3e34d70c-98b2-448d-8c3e-6f0f084d7a85 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 02 12:45:10.160872 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 6/13] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:10.221464 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-423cb2f9-edff-44c5-8fe9-5de616cb7909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3"}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:10.243236 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-423cb2f9-edff-44c5-8fe9-5de616cb7909 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076217 Nov 02 12:45:10.244353 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 8/14] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:10.259149 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-03282381-1755-4aee-9c6c-59368a2cf5a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:10.284318 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-03282381-1755-4aee-9c6c-59368a2cf5a1 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030239 Nov 02 12:45:10.285081 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 7/15] 10.222.0.90 () {64 vars in 1335 bytes} [Wed Nov 2 12:45:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:12.679681 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-423cb2f9-edff-44c5-8fe9-5de616cb7909 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:12.680749 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-423cb2f9-edff-44c5-8fe9-5de616cb7909 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Nov 02 12:45:12.681143 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 9/16] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:12.741531 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-8b760e20-7cdf-4439-a162-4f26248e0bbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:12.760454 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-8b760e20-7cdf-4439-a162-4f26248e0bbd admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073161 Nov 02 12:45:12.761296 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 8/17] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:12.773524 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-9a61e2b6-89ff-4103-8d8d-416b51a1b4fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:12.798725 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-9a61e2b6-89ff-4103-8d8d-416b51a1b4fc admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029316 Nov 02 12:45:12.799285 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 10/18] 10.222.0.90 () {64 vars in 1335 bytes} [Wed Nov 2 12:45:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:15.190509 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-8b760e20-7cdf-4439-a162-4f26248e0bbd admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:15.191557 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-8b760e20-7cdf-4439-a162-4f26248e0bbd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Nov 02 12:45:15.191929 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 9/19] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:15.253886 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-9f91b66a-b163-4d45-872e-5f7a8b124292 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:15.279602 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-9f91b66a-b163-4d45-872e-5f7a8b124292 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080851 Nov 02 12:45:15.280475 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 11/20] 10.222.0.90 () {60 vars in 1291 bytes} [Wed Nov 2 12:45:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:17.656866 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-8b760e20-7cdf-4439-a162-4f26248e0bbd admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:17.658667 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-8b760e20-7cdf-4439-a162-4f26248e0bbd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002816 Nov 02 12:45:17.659371 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 10/21] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:17 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:17.726392 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-58e3c0f5-4314-42e3-87a6-c4b9996484bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "swap": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:17.749540 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-58e3c0f5-4314-42e3-87a6-c4b9996484bb admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081609 Nov 02 12:45:17.750167 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 12/22] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:45:17.762649 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-ae1331c2-fa3c-4d94-9820-d6236fd90e19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:17.789301 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-ae1331c2-fa3c-4d94-9820-d6236fd90e19 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030565 Nov 02 12:45:17.792513 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 11/23] 10.222.0.90 () {64 vars in 1332 bytes} [Wed Nov 2 12:45:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:20.594054 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-58e3c0f5-4314-42e3-87a6-c4b9996484bb admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:20.595065 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-58e3c0f5-4314-42e3-87a6-c4b9996484bb admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 02 12:45:20.595575 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 13/24] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:20.654445 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-f19861a5-7681-4bf7-9546-e10b582b1942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:20.673510 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-f19861a5-7681-4bf7-9546-e10b582b1942 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071873 Nov 02 12:45:20.674066 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 12/25] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:45:20.686090 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-7a71319c-b4bb-4bd2-863e-c9079fb50562 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:20.711680 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-7a71319c-b4bb-4bd2-863e-c9079fb50562 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029296 Nov 02 12:45:20.712395 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 14/26] 10.222.0.90 () {64 vars in 1332 bytes} [Wed Nov 2 12:45:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:23.159126 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-f19861a5-7681-4bf7-9546-e10b582b1942 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:23.160150 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-f19861a5-7681-4bf7-9546-e10b582b1942 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 02 12:45:23.160606 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 13/27] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:23.217849 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-bf39a7e9-acc6-49e6-b7cf-1b177c00546a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:23.237529 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-bf39a7e9-acc6-49e6-b7cf-1b177c00546a admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070729 Nov 02 12:45:23.238110 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 15/28] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:23.250138 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-b9e6fb55-37b3-4486-9554-1e09e3bb5a34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:23.272599 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-b9e6fb55-37b3-4486-9554-1e09e3bb5a34 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026237 Nov 02 12:45:23.273345 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 14/29] 10.222.0.90 () {64 vars in 1332 bytes} [Wed Nov 2 12:45:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:25.640739 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-bf39a7e9-acc6-49e6-b7cf-1b177c00546a admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:25.642768 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-bf39a7e9-acc6-49e6-b7cf-1b177c00546a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Nov 02 12:45:25.644075 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 16/30] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:45:25.705519 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-a024fbfa-b27a-4521-a780-a43ac53bfbb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:25.724913 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-a024fbfa-b27a-4521-a780-a43ac53bfbb1 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074425 Nov 02 12:45:25.725566 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 15/31] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:25.737536 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-7a1de7ad-8ac4-4040-a0fb-8a5895f0d345 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:25.761980 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-7a1de7ad-8ac4-4040-a0fb-8a5895f0d345 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028187 Nov 02 12:45:25.762658 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 17/32] 10.222.0.90 () {64 vars in 1332 bytes} [Wed Nov 2 12:45:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:28.224314 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-a024fbfa-b27a-4521-a780-a43ac53bfbb1 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:28.225336 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-a024fbfa-b27a-4521-a780-a43ac53bfbb1 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Nov 02 12:45:28.225736 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 16/33] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:28.297633 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-0167b153-8be7-462e-89b6-d2fd32146d19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:28.316912 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-0167b153-8be7-462e-89b6-d2fd32146d19 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084986 Nov 02 12:45:28.318136 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 18/34] 10.222.0.90 () {64 vars in 1282 bytes} [Wed Nov 2 12:45:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:45:28.329809 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-81b268e3-e797-4d93-8ba9-9418962ba99a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:28.353637 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-81b268e3-e797-4d93-8ba9-9418962ba99a admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027494 Nov 02 12:45:28.354373 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 17/35] 10.222.0.90 () {64 vars in 1332 bytes} [Wed Nov 2 12:45:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:51.750079 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-0167b153-8be7-462e-89b6-d2fd32146d19 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:51.751099 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-0167b153-8be7-462e-89b6-d2fd32146d19 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 02 12:45:51.751500 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 19/36] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:51.816393 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-7017eec3-e191-4e63-acae-3fa5658dd56f admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:51.834790 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-7017eec3-e191-4e63-acae-3fa5658dd56f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076841 Nov 02 12:45:51.835650 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 18/37] 10.222.0.90 () {60 vars in 1291 bytes} [Wed Nov 2 12:45:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:53.268255 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-0167b153-8be7-462e-89b6-d2fd32146d19 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:53.269600 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-0167b153-8be7-462e-89b6-d2fd32146d19 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Nov 02 12:45:53.270152 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 20/38] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:53.478517 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-9e769e68-8dfe-40c1-bd91-e92ab160979f admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:53.484234 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.wsgi [None req-9e769e68-8dfe-40c1-bd91-e92ab160979f admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:45:53.484817 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-9e769e68-8dfe-40c1-bd91-e92ab160979f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:45:53.485623 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-9e769e68-8dfe-40c1-bd91-e92ab160979f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065779 Nov 02 12:45:53.486136 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 19/39] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Nov 2 12:45:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:53.497264 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-2c5303da-0b4b-4b3b-910c-13061690f39f admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:53.518869 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-2c5303da-0b4b-4b3b-910c-13061690f39f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025576 Nov 02 12:45:53.519475 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 21/40] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Nov 2 12:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:53.529757 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-418ffdc6-e414-4369-9e0e-bd93dbf59697 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:53.551056 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-418ffdc6-e414-4369-9e0e-bd93dbf59697 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025239 Nov 02 12:45:53.551608 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 20/41] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Nov 2 12:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:53.561388 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-35f994f0-7321-472c-8af4-7a4db9b82f55 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:53.567682 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.wsgi [None req-35f994f0-7321-472c-8af4-7a4db9b82f55 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:45:53.568257 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-35f994f0-7321-472c-8af4-7a4db9b82f55 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:45:53.569078 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-35f994f0-7321-472c-8af4-7a4db9b82f55 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011568 Nov 02 12:45:53.569544 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 22/42] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Nov 2 12:45:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:54.875026 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-418ffdc6-e414-4369-9e0e-bd93dbf59697 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:54.876049 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-418ffdc6-e414-4369-9e0e-bd93dbf59697 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Nov 02 12:45:54.876492 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 21/43] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:55.082141 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-e615b8e6-ef2b-41c7-af3a-a61aaa0f698c admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:55.088533 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.wsgi [None req-e615b8e6-ef2b-41c7-af3a-a61aaa0f698c admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:45:55.089074 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-e615b8e6-ef2b-41c7-af3a-a61aaa0f698c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:45:55.089864 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-e615b8e6-ef2b-41c7-af3a-a61aaa0f698c admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.073506 Nov 02 12:45:55.090374 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 23/44] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Nov 2 12:45:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:55.101672 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c5e29051-3a0f-44a0-9a1e-8da7923e2014 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:55.115793 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c5e29051-3a0f-44a0-9a1e-8da7923e2014 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018401 Nov 02 12:45:55.116382 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 22/45] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Nov 2 12:45:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:55.126468 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-f3689026-8399-4257-ba08-4c5314d1664d admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:55.140507 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-f3689026-8399-4257-ba08-4c5314d1664d admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017839 Nov 02 12:45:55.141031 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 24/46] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Nov 2 12:45:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:55.150675 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-ee3f3ea2-aa82-485d-83c4-5a1b9548a690 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:55.156776 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.wsgi [None req-ee3f3ea2-aa82-485d-83c4-5a1b9548a690 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:45:55.157343 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-ee3f3ea2-aa82-485d-83c4-5a1b9548a690 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:45:55.158134 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-ee3f3ea2-aa82-485d-83c4-5a1b9548a690 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011057 Nov 02 12:45:55.158635 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 23/47] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Nov 2 12:45:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:56.463367 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-f3689026-8399-4257-ba08-4c5314d1664d admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.464485 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-f3689026-8399-4257-ba08-4c5314d1664d admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001670 Nov 02 12:45:56.464957 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 25/48] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:56.681140 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-6a763514-b530-4147-bad7-e3edf26ea8e1 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.686785 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.wsgi [None req-6a763514-b530-4147-bad7-e3edf26ea8e1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:45:56.687344 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-6a763514-b530-4147-bad7-e3edf26ea8e1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:45:56.688133 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-6a763514-b530-4147-bad7-e3edf26ea8e1 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.083555 Nov 02 12:45:56.688706 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:56.699214 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-aa4a9227-5a6d-4415-b725-649bfc0d9d45 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.713149 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-aa4a9227-5a6d-4415-b725-649bfc0d9d45 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017529 Nov 02 12:45:56.713683 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 26/50] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:56.726393 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.744019 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023881 Nov 02 12:45:56.744587 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 25/51] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:45:56.754044 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-d5d38794-f251-4166-af68-278f9b154340 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.759539 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.wsgi [None req-d5d38794-f251-4166-af68-278f9b154340 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:45:56.760094 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-d5d38794-f251-4166-af68-278f9b154340 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:45:56.760917 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-d5d38794-f251-4166-af68-278f9b154340 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010509 Nov 02 12:45:56.761411 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 27/52] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:58.074175 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:58.075164 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Nov 02 12:45:58.075558 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 26/53] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:45:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:58.278939 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-6576e9ab-65e8-4c4d-9fdb-2426a17f3776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:58.299342 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-6576e9ab-65e8-4c4d-9fdb-2426a17f3776 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083000 Nov 02 12:45:58.299904 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 28/54] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Nov 2 12:45:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:45:59.650483 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:59.652336 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002442 Nov 02 12:45:59.653001 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 27/55] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:59.863330 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-abcd35c5-7d0a-48f4-ace9-b6075af3fb1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:59.884388 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-abcd35c5-7d0a-48f4-ace9-b6075af3fb1f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.084055 Nov 02 12:45:59.884924 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 29/56] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Nov 2 12:45:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:46:01.200078 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:01.201355 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Nov 02 12:46:01.201902 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 28/57] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:46:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:01.401626 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-329ec5ae-0fe8-4966-96b0-1f9e46288e68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:01.422694 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-329ec5ae-0fe8-4966-96b0-1f9e46288e68 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083665 Nov 02 12:46:01.423237 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 30/58] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Nov 2 12:46:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:46:02.733615 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:02.735203 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 Nov 02 12:46:02.735846 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 29/59] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:46:02.950780 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-b773c087-6fed-4f0d-8638-540e4ebbd4ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:02.971689 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-b773c087-6fed-4f0d-8638-540e4ebbd4ff admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078725 Nov 02 12:46:02.972272 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 31/60] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Nov 2 12:46:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:46:04.295486 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:04.296635 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Nov 02 12:46:04.297035 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 30/61] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:46:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:04.503517 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-8dfe60dc-ac5b-47db-996f-4b59f8707ed7 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:04.522826 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-8dfe60dc-ac5b-47db-996f-4b59f8707ed7 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.086400 Nov 02 12:46:04.523361 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1202 bytes} [Wed Nov 2 12:46:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:52.812583 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.813563 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-c0b54a63-da49-4b3b-8fa3-e6768c720262 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Nov 02 12:46:52.813970 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 31/63] 10.222.0.90 () {54 vars in 930 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:52.881017 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-745b97ba-59a8-47bc-a327-9076403d18ba admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.904726 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-745b97ba-59a8-47bc-a327-9076403d18ba admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084309 Nov 02 12:46:52.905281 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 33/64] 10.222.0.90 () {60 vars in 1291 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:52.927232 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-b3cfe3c1-b6e2-4c3f-89ac-6516cdb9b875 admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.935494 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-b3cfe3c1-b6e2-4c3f-89ac-6516cdb9b875 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012076 Nov 02 12:46:52.935987 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 32/65] 10.222.0.90 () {60 vars in 1282 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:52.947372 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-f302db25-39c3-4ab5-9e12-dc0e812743a0 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.956742 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-f302db25-39c3-4ab5-9e12-dc0e812743a0 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012894 Nov 02 12:46:52.957272 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 34/66] 10.222.0.90 () {60 vars in 1285 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:52.969211 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.977348 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011987 Nov 02 12:46:52.977870 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 33/67] 10.222.0.90 () {60 vars in 1285 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:52.992249 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-a333a116-2a4e-4bc3-8c9b-5d00d6c02fd8 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:53.000237 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-a333a116-2a4e-4bc3-8c9b-5d00d6c02fd8 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011734 Nov 02 12:46:53.000806 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 35/68] 10.222.0.90 () {60 vars in 1282 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:09.041951 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:09.043048 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Nov 02 12:50:09.043440 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 34/69] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:50:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:09.306590 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-b861985a-a72e-44ee-8eff-46581d439f2a admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:09.307781 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:50:09.307781 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: warnings.warn(msg) Nov 02 12:50:09.308988 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-b861985a-a72e-44ee-8eff-46581d439f2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:09.309421 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-b861985a-a72e-44ee-8eff-46581d439f2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:09.310200 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-b861985a-a72e-44ee-8eff-46581d439f2a admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:09.310651 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-b861985a-a72e-44ee-8eff-46581d439f2a admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:09.344154 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-b861985a-a72e-44ee-8eff-46581d439f2a admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159163 Nov 02 12:50:09.344743 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 36/70] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Nov 2 12:50:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:50:10.672384 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:10.673385 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Nov 02 12:50:10.673777 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 35/71] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:10.864958 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-1289a807-879c-43ae-9f3c-c881b26b4692 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:10.866128 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:50:10.866128 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: warnings.warn(msg) Nov 02 12:50:10.867338 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-1289a807-879c-43ae-9f3c-c881b26b4692 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:10.867783 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-1289a807-879c-43ae-9f3c-c881b26b4692 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:10.868594 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-1289a807-879c-43ae-9f3c-c881b26b4692 admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:10.869019 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-1289a807-879c-43ae-9f3c-c881b26b4692 admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:10.888369 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-1289a807-879c-43ae-9f3c-c881b26b4692 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075221 Nov 02 12:50:10.888923 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 37/72] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Nov 2 12:50:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:50:22.648775 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:22.650111 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001856 Nov 02 12:50:22.650550 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 36/73] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:50:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:22.845155 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-bea3a9ef-0bab-4265-9092-c5e4a6f60714 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:22.846535 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:50:22.846535 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: warnings.warn(msg) Nov 02 12:50:22.847877 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-bea3a9ef-0bab-4265-9092-c5e4a6f60714 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:22.848450 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-bea3a9ef-0bab-4265-9092-c5e4a6f60714 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:22.849668 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-bea3a9ef-0bab-4265-9092-c5e4a6f60714 admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:22.850161 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-bea3a9ef-0bab-4265-9092-c5e4a6f60714 admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:22.877896 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-bea3a9ef-0bab-4265-9092-c5e4a6f60714 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086534 Nov 02 12:50:22.878456 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 38/74] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Nov 2 12:50:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:50:24.198068 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: DEBUG nova.api.openstack.wsgi [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] Calling method '>' {{(pid=109727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:24.199075 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: INFO nova.api.openstack.requestlog [None req-0d500610-07dc-4cbc-b634-25bbc4c9f66a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Nov 02 12:50:24.199894 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: [pid: 109727|app: 0|req: 37/75] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Nov 2 12:50:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:24.396275 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG nova.api.openstack.wsgi [None req-ff2fa172-d18b-4827-a17e-8d4aa328ae80 admin admin] Calling method '>' {{(pid=109728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:24.397437 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:50:24.397437 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: warnings.warn(msg) Nov 02 12:50:24.398616 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-ff2fa172-d18b-4827-a17e-8d4aa328ae80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:24.399413 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-ff2fa172-d18b-4827-a17e-8d4aa328ae80 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:24.400187 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-ff2fa172-d18b-4827-a17e-8d4aa328ae80 admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:50:24.400766 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: DEBUG oslo_concurrency.lockutils [None req-ff2fa172-d18b-4827-a17e-8d4aa328ae80 admin admin] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:50:24.422275 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: INFO nova.api.openstack.requestlog [None req-ff2fa172-d18b-4827-a17e-8d4aa328ae80 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078777 Nov 02 12:50:24.422840 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: [pid: 109728|app: 0|req: 39/76] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Nov 2 12:50:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:51:27.918318 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: Wed Nov 2 12:51:27 2022 - graceful shutdown triggered... Nov 02 12:51:27.918406 dv-cinder-863278-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 12:51:27.919551 dv-cinder-863278-1-iscsi devstack@n-api.service[109727]: Gracefully killing worker 1 (pid: 109727)... Nov 02 12:51:27.919988 dv-cinder-863278-1-iscsi devstack@n-api.service[109728]: Gracefully killing worker 2 (pid: 109728)... Nov 02 12:51:28.920696 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: worker 1 buried after 1 seconds Nov 02 12:51:28.920696 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: worker 2 buried after 1 seconds Nov 02 12:51:28.920696 dv-cinder-863278-1-iscsi devstack@n-api.service[109726]: goodbye to uWSGI. Nov 02 12:51:28.923235 dv-cinder-863278-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 12:51:28.924166 dv-cinder-863278-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 12:51:28.928790 dv-cinder-863278-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:51:28.950734 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:51:28 2022] *** Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: nodename: dv-cinder-863278-1-iscsi Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: machine: x86_64 Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: clock source: unix Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: pcre jit disabled Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: detected number of CPU cores: 4 Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: current working directory: / Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: your processes number limit is 47680 Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: your memory page size is 4096 bytes Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: detected max file descriptor number: 2048 Nov 02 12:51:28.976140 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: lock engine: pthread robust mutexes Nov 02 12:51:28.977288 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: thunder lock: enabled Nov 02 12:51:28.977288 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:51:28.977288 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:51:29.022848 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: Python main interpreter initialized at 0x562aab8c79c0 Nov 02 12:51:29.022848 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: python threads support enabled Nov 02 12:51:29.022848 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: your server socket listen backlog is limited to 100 connections Nov 02 12:51:29.022848 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:51:29.023615 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:51:29.023696 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: *** Operational MODE: preforking *** Nov 02 12:51:29.023945 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:51:29.023945 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: spawned uWSGI master process (pid: 124263) Nov 02 12:51:29.024183 dv-cinder-863278-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:51:29.026483 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: spawned uWSGI worker 1 (pid: 124277, cores: 1) Nov 02 12:51:29.026483 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: spawned uWSGI worker 2 (pid: 124278, cores: 1) Nov 02 12:51:29.026483 dv-cinder-863278-1-iscsi devstack@n-api.service[124263]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:51:30.231779 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:51:30.234318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:51:31.181702 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:51:31.181702 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: from cryptography.utils import int_from_bytes Nov 02 12:51:31.182079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:51:31.182079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: from cryptography.utils import int_from_bytes Nov 02 12:51:31.182263 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:51:31.182263 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: from cryptography.utils import int_from_bytes Nov 02 12:51:31.182485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:51:31.182485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: from cryptography.utils import int_from_bytes Nov 02 12:51:33.560665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:51:33.561286 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:51:33.561396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:51:33.561725 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:51:33.561987 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:51:33.562386 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.562723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.563051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.563409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.563745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.564061 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.564408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.564735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.565071 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.565309 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.565654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.565986 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863278-1-iscsi {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.566310 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.566682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.566930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.567236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.567573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.567866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.568235 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.568727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.568992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:51:33.569399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:51:33.569474 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.570865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:51:33.571097 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.571097 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.571529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:51:33.571529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:51:33.571961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.571961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.572519 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.572730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.572968 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.573182 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.573394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.573595 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.573824 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.574039 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.574240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.574240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.574650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.574892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.575094 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863278-1-iscsi {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.575331 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.575538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.575729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.575916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.576097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.576320 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.576524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.576524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863278-1-iscsi {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.576808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.576960 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.577099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.577277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.577428 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.577593 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.577750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.577899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.578044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.578189 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.578341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.578480 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.578665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.578810 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.578959 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.579107 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.579271 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.579425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.579564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.579714 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.579862 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.580024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.580162 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.580637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.580801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.580952 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.581324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.581473 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.581980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.582141 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.582289 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.582289 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.582559 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.582700 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.582850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.583014 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.583166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.583312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.583459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863278-1-iscsi {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.583599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.583757 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.583897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.584057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.584331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.584503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.584658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.584817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.584966 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.585117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.585267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.585413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.585560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.585707 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.585854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.586000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.586147 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.586293 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.586445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.586608 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.586754 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.586900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.587052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.587210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.587359 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.587505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.587798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.587985 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.588139 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.588469 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.588624 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.588763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.588921 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.589068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.589215 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.589364 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.589503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.589652 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.589797 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.589935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.590073 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.590228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.590375 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.590748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.590915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.591074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.591249 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.591471 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.591682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.592188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.592188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.592518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.592518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.592784 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.592932 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.593088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.593285 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.593444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.593444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.593807 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.593947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.594085 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.594233 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.594380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.594380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.594658 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.594796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.594950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.595097 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.595256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.595404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.595544 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.595688 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.595840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.595987 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.596125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.596283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.596426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.596579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.596764 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.596918 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.597057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.597208 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.597356 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.597496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.597646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.597792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.597930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.598079 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.598225 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.598364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.598516 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.598656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.598798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.598946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.599092 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.599239 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.599386 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.599678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.599831 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.599970 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.600988 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.601164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.601315 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.601480 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.601692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.601839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.602135 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.602533 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.602692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.602842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603002 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603146 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603547 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603693 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.603983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.604122 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.604305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.604457 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.604603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.604751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.604892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.605039 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.605185 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.605331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.605484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.605632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.605779 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.605919 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.606058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.606218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.606381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.606528 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.606675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.606814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.606958 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.607104 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.607256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.607396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.607536 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.607680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.607825 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.607983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.608134 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.608869 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.609026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.609170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.609321 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.609467 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.609467 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.609834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.609989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.610371 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.610523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.610690 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.611059 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.611249 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.611395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.611543 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.611709 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.611941 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.612103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.612369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.612369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.612866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.613027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.613198 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.613339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.613482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.613621 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.613759 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.613915 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.614054 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.614194 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.614341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.614479 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.614617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.614768 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.614908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.615057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.615203 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.615342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.615489 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.615638 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.615785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.615923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.616069 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.616226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.616384 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.616533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.616533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.616812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.616969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.617108 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.617255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.617394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.617533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.617672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.617816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.617955 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.618109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.618255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.618413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.619292 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.619546 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.619700 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.619869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:51:33.620096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.620282 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.620442 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.620592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.620748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.620889 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.621263 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.621421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.621572 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.621816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.622475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.622654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.622945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.623108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.623261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.623412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.623834 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.624010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.624160 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.624416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.624617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.624774 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.624936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.625086 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.625233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.625380 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.625531 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.625679 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.625819 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.625968 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.626186 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.626328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.626468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.626614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.626850 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.627017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.627160 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.627301 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.627443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.627590 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.627746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.627887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.628052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.628223 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.628370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.628520 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.628669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.628817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.628967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.629116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.629262 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.629401 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.629553 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.629700 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.629844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.629844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.630138 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.630360 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.630521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.630671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.630819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.630969 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.631109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.631445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.631602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.631743 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.631893 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.632058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.632302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.632479 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.632695 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.632695 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.632992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.633240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.633393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.633393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.633684 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.633923 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.634078 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.634219 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.634368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.634516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.634753 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.634908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.635056 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.635196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.635366 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.635517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.635656 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.635801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.635940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.636086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.636314 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.636464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.636611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.636758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.636994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.637136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.637283 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.637437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.637576 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.637716 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.637862 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.637862 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.638137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.638286 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.638425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.638425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.638695 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.638843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.638983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.639128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.639281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.639419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.639559 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.639707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.639858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.639858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.640129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.640289 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.640523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.640688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.640829 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.640969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.641122 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.641270 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.641502 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.641663 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.641804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.642023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.642173 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.642345 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.642614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.642859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.643023 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.643210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.643464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.643632 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.643788 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.643956 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.644189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.644427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.644569 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.644708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.644862 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.645011 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.645158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.645316 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.645316 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.645648 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.645827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.645977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.646116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.646255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.646394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.646548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.646703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.646843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.646981 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.647119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.647264 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.647416 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.647632 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.647789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.648299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.648447 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.648605 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.648758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.648898 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.649038 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.649176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.649315 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.649453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.649600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.649747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.649904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.650050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.650189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.650392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.650392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.650763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.650916 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.651068 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.651217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.651365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.651530 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.651743 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.651888 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.652039 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.652187 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.652481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.652711 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.652916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.653078 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.653222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.653460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.653711 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.653859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.654000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.654139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.654393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.654561 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.654712 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.654852 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.654991 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.655129 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.655269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.655421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.655561 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.655748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.655899 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.656048 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.656195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.656370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.656531 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.656679 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.656818 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.656956 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.657102 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.657298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.657455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.657603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.657749 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.657888 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.658036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.658036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.658354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.658528 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.658677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.658833 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.658989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.659129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.659280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.659435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.659582 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.659735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.659887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.660027 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.660174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.660359 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.660511 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.660649 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.660890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.661045 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.661191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.661338 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.661487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.661636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.661817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.661974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.662121 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.662261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.662418 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.662573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.662730 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.662936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.663096 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.663247 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.663394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.663549 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.663708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.663935 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.664097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.664256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.664420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.664671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.664826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.664978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.665119 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.665268 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.665416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.665569 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.665710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.665871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.666026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.666167 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.666315 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.666518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.666678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.666818 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.666965 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.667121 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.667275 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.667417 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.667555 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.667693 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.667839 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.667989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.668137 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.668340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.668488 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.668638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.668778 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.668917 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669069 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669209 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669347 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669647 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669937 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.669937 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.670219 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.670365 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.670517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.670669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.670808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.671029 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.671175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.671321 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.671469 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.671617 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.671757 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.671895 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.672037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.672182 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.672355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.672516 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.672656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.672803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.672803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.673730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.673730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.674199 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.674199 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.674476 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.674615 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.674868 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.675027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.675191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.675332 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.675480 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.675627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.675767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.675920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.676061 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.676254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.676401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.676542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.676681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.676836 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.676978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.677135 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.677276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.677416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.677555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.677703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.677843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.677990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.678137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.678276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.678426 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.678573 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.678573 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.678844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.678995 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.679142 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.679290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.679432 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.679580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.679727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.679875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.680015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.680170 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.680364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.680507 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.680646 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.680798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.680951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.681195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.681488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.681687 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.681929 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.682087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.682243 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.682389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.682535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.682680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.682835 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.682989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.683161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.683323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.683469 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.683622 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.683777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.683935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.684080 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.684419 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.684601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.684601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.685009 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.685172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.685327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.685484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.685632 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.685794 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.685947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.686103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.686257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.686403 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.686548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.686703 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.686856 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.687012 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.687158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.687319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.687466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.687638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.687864 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.688029 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.688187 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.688358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.688504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.688650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.688796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.688944 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.689106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.689262 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.689426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.689573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.689719 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.689877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.690038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.690038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.690315 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.690460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.690604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.690763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.690918 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.691063 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.691295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.691460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.691614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.691771 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.691927 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.692132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.692323 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.692482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.692629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.692629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.692915 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.693072 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.693226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.693373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.693533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.693689 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.693834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.693979 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.694133 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.694287 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.694464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.694702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.694853 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.695025 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.695267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.695427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.695598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.695753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.695900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.696046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.696218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.696372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.696530 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.696676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.696829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.696974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.697497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.698149 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.698526 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.698728 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.698884 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.699040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.699187 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.699344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.699500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.699657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.699854 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.700017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.700167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.700403 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.700569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.700733 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.700894 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.701047 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.701202 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.701448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.701604 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.701759 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.701907 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.702058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.702212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.702370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.702525 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.702672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.702826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.702990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.703150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.703150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.703441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.703595 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.703741 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.703887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.704051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.704219 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.704386 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.704543 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.704715 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.704975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.705138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.705313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.705550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.705703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.705849 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.705995 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.706155 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.706311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.706465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.706620 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.706779 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.706938 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.707104 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.707251 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.707397 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.707543 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.707689 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.707843 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.707989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.708142 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.708365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.708513 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.708666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.708829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.708976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.709143 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.709290 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.709436 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.709582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.709739 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.709886 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.710032 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.710177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.710329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.710565 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.710722 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.710877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.711038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.711199 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.711354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.711591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.711591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.711885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.712039 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.712192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.712460 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.712662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.712886 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.713042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.713195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.713349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.713515 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.713746 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.713917 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.714076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.714076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.714368 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.714532 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.714678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.714835 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.715009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.715256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.715416 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.715602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.715838 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.715990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.716145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.716480 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.716630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.716792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.716949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.717106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.717265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.717413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.717558 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.717713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.717870 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.718025 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.718173 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.718333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.718488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.718634 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.718787 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.718935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.719087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.719234 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.719388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.719542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.719688 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.719900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.720060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.720230 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.720395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.720552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.720698 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.720847 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.721082 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.721247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.721433 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.721601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.721761 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.721919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.722228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.722401 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.722550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.722696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.722859 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.723092 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.723244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.723406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.723562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.723717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.723866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.724021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.724187 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.724401 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.724557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.724710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.724864 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.725019 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.725164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.725434 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.725590 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.725743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.725743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.726019 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.726019 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.726433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.726591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.726747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.726747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.727033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.727206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.727361 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.727516 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.727675 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.727821 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.727967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.728122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.728326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.728563 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.728721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.728876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.729036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.729199 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.729353 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.729521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.729681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.729834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.729990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.730137 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.730299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.730451 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.730618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.730774 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.730933 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.731088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.731241 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.731403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.731549 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.731695 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.731849 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.731996 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.732148 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.732354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.732517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.732683 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.732846 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.732999 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.733145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.733299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.733446 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.733605 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.733760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.733923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.734082 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.734230 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.734378 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.734547 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.734695 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.734840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.734840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.735128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.735285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.735458 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.735697 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.735857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.736006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.736159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.736343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.736503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.736673 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.736828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.736975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.737128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.737274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.737438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.737592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.737745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.737745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.738037 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.738037 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.738352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.738514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.738679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.738679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.738973 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.739123 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.739276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.739276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.739559 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.739724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.739878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.740046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.740250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.740406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.740582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.740743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.740897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.741043 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.741190 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.741335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.741480 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.741636 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.741790 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.741939 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.742085 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.742240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.742393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.742566 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.742722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.742876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.743024 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.743024 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.743335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.743491 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.743637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.743782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.743984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.744140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.744332 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.744483 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.744639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.744785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.744938 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.745084 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.745256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.745413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.745567 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.745738 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.745975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.746135 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.746297 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.746451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.746615 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.746769 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.746915 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.747070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.747217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.747368 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.747524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.747669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.747822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.747978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.748132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.748326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.748487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.748653 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.748806 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.748964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.749114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.749260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.749407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.749552 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.749710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.749871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.750033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.750202 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.750349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.750503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.750683 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.750839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.751047 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.751201 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.751356 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.751510 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.751670 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.751826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.751984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.752138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.752325 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.752482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.752647 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.752816 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.752975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.753123 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.753268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.753413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.753572 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.753726 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.753885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.754033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.754180 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.754340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.754487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.754643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.754797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.754952 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.755105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.755260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.755406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.755552 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.755707 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.755854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.756017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.756286 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.756452 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.756599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.756756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.756911 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.757066 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.757213 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.757358 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.757573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.757788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.757938 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.758100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.758261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.758408 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.758561 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.758708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.758708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.759015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.759169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.759315 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.759461 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.759635 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.759784 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.759939 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.760088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.760256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.760428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.760584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.760741 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.760905 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.761057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.761205 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.761350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.761495 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.761650 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.761797 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.761949 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.762094 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.762242 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.762388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.762542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.762700 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.762846 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.762991 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.763146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.763293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.763448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.763448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.763733 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.763890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.764036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.764330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.764488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.764637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.764795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.764941 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.765093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.765257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.765422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.765570 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.765716 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.765875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.766029 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.766191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.766451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.766611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.766768 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.766930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.767085 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.767264 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.767422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.767586 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.767735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.767888 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.768044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.768191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.768377 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.768377 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.768661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.768820 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.768976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.769130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.769276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.769433 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.769581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.769734 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.769899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.770045 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.770198 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.770344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.770490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.770661 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.770809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.770954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.771107 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.771253 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.771407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.771636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.771787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.771934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.772089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.772324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.772490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.772650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.772805 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.773268 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.773426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.773573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.773737 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.773888 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.774035 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.774181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.774334 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.774481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.774636 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.774809 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.774960 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.775134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.775322 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.775480 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.775629 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.775775 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.775922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.776070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.776238 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.776405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.776660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.776824 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.776982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.776982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.777284 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.777432 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.777586 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.777733 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.777879 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.778033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.778192 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.778339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.778493 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.778639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.778809 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.778965 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.779121 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.779275 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.779423 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.779568 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.779714 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.779861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780021 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780353 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780657 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.780991 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781253 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781253 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781403 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781652 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781736 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781898 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.781979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782156 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782512 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782781 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.782956 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783377 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783526 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783605 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783747 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783747 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783895 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.783983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784135 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784304 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784476 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784772 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.784943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785095 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785597 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.785934 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786034 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786208 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786291 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786379 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786469 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786553 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786650 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.786968 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787066 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787157 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787375 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787774 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.787949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788037 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788230 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.788707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789213 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789559 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789648 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.789989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790159 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790352 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790518 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.790947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791024 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791104 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791183 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791343 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791590 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791757 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.791851 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792315 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792510 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792888 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.792991 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793077 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793436 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793536 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793536 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793731 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793811 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.793977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794075 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794806 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794888 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.794981 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795224 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795314 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795397 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795579 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.795919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796086 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796279 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796715 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.796975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.797211 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.797302 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.797534 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.797634 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.797861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.797962 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.798195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.798285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.798514 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.798611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.798842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.798946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.799167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.799256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.799497 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.799602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.799806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.799906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.800121 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.800273 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.800565 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.800684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.800887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.800988 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.801214 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.801305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.801555 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.801655 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.801879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.801970 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.802190 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.802285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.802501 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.802627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.802843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.803117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.803247 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.803448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.803577 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.803756 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.803892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.804074 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.804361 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.804492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.804704 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.804851 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.805011 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.805147 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.805323 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.805461 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.805633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.805776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.805973 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.806103 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.806344 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.806614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.806744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.806879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.807014 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.807186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.807324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.807524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.807656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.807840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.807968 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.808156 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.808311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.808499 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.808641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.808823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.808953 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.809153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.809283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.809472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.809609 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.809785 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.809913 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.810096 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.810226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.810414 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.810551 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.810781 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.810918 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.811052 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.811177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.811342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.811472 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.811651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.811782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.811970 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.812098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.812295 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.812424 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.812602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.812731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.812963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.813097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.813293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.813430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.813617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.813752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.813975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.814127 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.814276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.814412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.814595 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.814734 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.814915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.815057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.815233 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.815367 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.815548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.815684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.815860 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.816005 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.816181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.816327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.816527 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.816665 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.816864 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.817011 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.817195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.817322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.817518 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.817646 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.817848 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.817974 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.818200 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.818328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.818524 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.818660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.818879 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.819017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.819200 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.819326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.819518 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.819653 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.819835 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.819964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.820148 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.820296 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.820422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:51:33.820558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.820812 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.821132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.821455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.821826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.822302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.822653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.822992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.823332 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.823660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.824093 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.824454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.824778 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.825122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.825443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.825762 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.826088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.826407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.826729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.827053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.827379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.827715 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.828050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.828416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.828753 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.829108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.829428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.829780 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.830115 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.830438 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.830766 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.831079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:51:33.831328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:51:33.844402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:33.854819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:33.909326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.context [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df971900-0a53-43b2-b0cc-1fe63c2db549(cell1) {{(pid=124277) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:51:33.913560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:51:33.915107 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:51:33.916045 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:51:33.918041 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:51:33.919361 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.context [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df971900-0a53-43b2-b0cc-1fe63c2db549(cell1) {{(pid=124278) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:51:33.923639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:51:33.925246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:51:33.926123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:51:33.928006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:51:33.929268 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:33.931285 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:33.939293 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:33.940797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:34.096062 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:34.099692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:51:34.539644 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:51:34.545545 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:51:34.546484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:51:34.552173 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:51:34.771222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:51:34.774805 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:51:34.777558 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e731a904-1a64-4066-b3d2-ac329d563d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:51:34.780169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-803d6515-fcb7-4c43-9999-d76ae11145d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:51:34.783058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562aab8c79c0 pid: 124277 (default app) Nov 02 12:51:34.785646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562aab8c79c0 pid: 124278 (default app) Nov 02 12:52:25.822917 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ca684f2b-acaa-4512-8f9c-a02c70052cb0 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Action: 'create', calling method: .version_select at 0x7fbe445a6ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-934121561"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:27.124864 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9934449b-e16c-4ac8-a79a-69d4b7935489 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Action: 'create', calling method: .version_select at 0x7fbe445a4ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-974777302", "metadata": {"Type": "work"}}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:27.126699 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9934449b-e16c-4ac8-a79a-69d4b7935489 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:27.127845 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9934449b-e16c-4ac8-a79a-69d4b7935489 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.085402 Nov 02 12:52:27.133333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 1/1] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Nov 2 12:52:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1092 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:52:27.139593 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c9cca5d4-e198-44f2-9df9-0b2ed88fa161 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Action: 'create', calling method: .version_select at 0x7fbe444abca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-221752851", "metadata": {"Type": "work"}}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:27.141420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c9cca5d4-e198-44f2-9df9-0b2ed88fa161 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:27.142475 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c9cca5d4-e198-44f2-9df9-0b2ed88fa161 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007597 Nov 02 12:52:27.148416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 2/2] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Nov 2 12:52:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:52:27.153611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b75df527-38d0-4c6a-adfd-5942858e7ef9 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Action: 'create', calling method: .version_select at 0x7fbe444ab9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1906138589", "metadata": {"Type": "work"}}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:27.155101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b75df527-38d0-4c6a-adfd-5942858e7ef9 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:27.156138 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b75df527-38d0-4c6a-adfd-5942858e7ef9 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006472 Nov 02 12:52:27.162034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 3/3] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Nov 2 12:52:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:52:27.168414 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-63c00750-2210-47fa-b5c4-e868994a10c1 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Calling method '.version_select at 0x7fbe444489d0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:27.703257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-63c00750-2210-47fa-b5c4-e868994a10c1 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] HTTP exception thrown: Volume tempest-invalid-1932636696 could not be found. Nov 02 12:52:27.704048 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-63c00750-2210-47fa-b5c4-e868994a10c1 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Returning 404 to user: Volume tempest-invalid-1932636696 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:27.705891 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-63c00750-2210-47fa-b5c4-e868994a10c1 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1932636696" status: 404 len: 99 microversion: 2.1 time: 0.542509 Nov 02 12:52:27.706446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 4/4] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Nov 2 12:52:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1932636696 => generated 99 bytes in 544 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:52:27.728257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4eea91d0-33b2-47a2-a3a0-d2b2b002188c tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012137 Nov 02 12:52:27.729944 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 5/5] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Nov 2 12:52:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:52:27.755668 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ee9458bf-fbab-4fbe-b15b-892d265613b0 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018280 Nov 02 12:52:27.757752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 6/6] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Nov 2 12:52:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:52:27.767023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3a4756c5-db45-4af1-9af6-e545ec39739a tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Calling method '.version_select at 0x7fbe443ca1f0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:27.820961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ca684f2b-acaa-4512-8f9c-a02c70052cb0 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.970971 Nov 02 12:52:27.821711 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 1/7] 10.222.0.90 () {60 vars in 1155 bytes} [Wed Nov 2 12:52:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2973 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:52:27.840693 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bb38d6ca-fb43-4a34-95ca-0ee6c05573fc tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe44422d30>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:27.937555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bb38d6ca-fb43-4a34-95ca-0ee6c05573fc tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 200 len: 344 microversion: 2.1 time: 0.101498 Nov 02 12:52:27.938704 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 2/8] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:27 2022] GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:27.977196 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-3a4756c5-db45-4af1-9af6-e545ec39739a tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] HTTP exception thrown: Volume 29ffe587-c9de-4869-bf1e-be27d6ebf1cf could not be found. Nov 02 12:52:27.978067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3a4756c5-db45-4af1-9af6-e545ec39739a tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Returning 404 to user: Volume 29ffe587-c9de-4869-bf1e-be27d6ebf1cf could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:27.979013 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3a4756c5-db45-4af1-9af6-e545ec39739a tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/29ffe587-c9de-4869-bf1e-be27d6ebf1cf" status: 404 len: 109 microversion: 2.1 time: 0.215723 Nov 02 12:52:27.980244 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 7/9] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 12:52:27 2022] DELETE /compute/v2.1/os-volumes/29ffe587-c9de-4869-bf1e-be27d6ebf1cf => generated 109 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:27.991226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0dc39e60-48eb-4a06-8a76-8a9ab4541e00 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Calling method '.version_select at 0x7fbe44422ca0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:28.025088 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-0dc39e60-48eb-4a06-8a76-8a9ab4541e00 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] HTTP exception thrown: Volume 5283ceb5-e2fd-492c-a0dc-cf671b26310a could not be found. Nov 02 12:52:28.025742 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0dc39e60-48eb-4a06-8a76-8a9ab4541e00 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] Returning 404 to user: Volume 5283ceb5-e2fd-492c-a0dc-cf671b26310a could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:28.026814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0dc39e60-48eb-4a06-8a76-8a9ab4541e00 tempest-VolumesNegativeTest-529321410 tempest-VolumesNegativeTest-529321410-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5283ceb5-e2fd-492c-a0dc-cf671b26310a" status: 404 len: 109 microversion: 2.1 time: 0.040200 Nov 02 12:52:28.036236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 3/10] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:27 2022] GET /compute/v2.1/os-volumes/5283ceb5-e2fd-492c-a0dc-cf671b26310a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:28.954543 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7618b554-d1d6-42b3-92cc-d370b2122552 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b3d30>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:29.066453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7618b554-d1d6-42b3-92cc-d370b2122552 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 200 len: 344 microversion: 2.1 time: 0.115430 Nov 02 12:52:29.069537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 8/11] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:28 2022] GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:30.084825 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-81e17c1e-1cd2-4d9b-84c3-6736da49419e tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe44da1820>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:30.171677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-81e17c1e-1cd2-4d9b-84c3-6736da49419e tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 200 len: 345 microversion: 2.1 time: 0.081707 Nov 02 12:52:30.171677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 4/12] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:30 2022] GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:30.179881 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d0151036-f7c6-4194-88c2-e041c2ba4fd6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Action: 'create', calling method: .version_select at 0x7fbe443ca430>, body: {"snapshot": {"volume_id": "1cb20f25-d255-44ad-8e74-a710626052f8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1844634301"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:30.491166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d0151036-f7c6-4194-88c2-e041c2ba4fd6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.317543 Nov 02 12:52:30.492379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 9/13] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Nov 2 12:52:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:30.503839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a309cba5-fc00-40d9-8db6-1dc543ea745f tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b6310>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:30.619055 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a309cba5-fc00-40d9-8db6-1dc543ea745f tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.118932 Nov 02 12:52:30.619990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 5/14] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:30 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:30.634462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c5f17575-b2fd-4c0d-bb34-a3bdbd915899 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443d90d0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:30.725754 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c5f17575-b2fd-4c0d-bb34-a3bdbd915899 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.098120 Nov 02 12:52:30.727618 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 10/15] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Nov 2 12:52:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:30.738892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b55e9ea1-c47e-402f-9cea-4803cd6e0a5f tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b6ca0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:30.771464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b55e9ea1-c47e-402f-9cea-4803cd6e0a5f tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.036431 Nov 02 12:52:30.772563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 6/16] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:30 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:31.785025 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c657eefa-7d30-48a8-9605-c57cda33f502 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443ca9d0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:31.866897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c657eefa-7d30-48a8-9605-c57cda33f502 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.085581 Nov 02 12:52:31.867458 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 11/17] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:31 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:32.879372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f452c268-c7b9-4180-aabe-2f226a296122 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443c33a0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:32.942931 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f452c268-c7b9-4180-aabe-2f226a296122 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.066907 Nov 02 12:52:32.949435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 7/18] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:32 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:33.955830 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4fad3a80-ba17-4a28-909f-140ef34d48a1 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443ca820>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:34.010057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4fad3a80-ba17-4a28-909f-140ef34d48a1 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.058346 Nov 02 12:52:34.015787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 12/19] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:33 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:35.027007 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bf673c3f-d024-4157-a97c-f50832939970 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b6af0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:35.097662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bf673c3f-d024-4157-a97c-f50832939970 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.078945 Nov 02 12:52:35.108502 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 8/20] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:35 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:36.110756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d134c50c-d464-48aa-afa1-ff9cb2e050c4 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b3d30>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:36.164472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d134c50c-d464-48aa-afa1-ff9cb2e050c4 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.057092 Nov 02 12:52:36.165537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 13/21] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:36 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:37.177028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d70dbf65-4dd5-4243-8a6f-3280b3f28063 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b6670>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:37.232180 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d70dbf65-4dd5-4243-8a6f-3280b3f28063 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.058588 Nov 02 12:52:37.232770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 9/22] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:37 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:38.245617 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-19403f20-9ea5-4637-bfd5-8d5ab0cf1c1f tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443d9700>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:38.337916 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-19403f20-9ea5-4637-bfd5-8d5ab0cf1c1f tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 288 microversion: 2.1 time: 0.097039 Nov 02 12:52:38.338483 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 14/23] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:38 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:38.349944 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-06380d45-1d6e-4a80-9a25-cfc845b3da62 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe44da1820>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:38.513344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-06380d45-1d6e-4a80-9a25-cfc845b3da62 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "DELETE /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 202 len: 0 microversion: 2.1 time: 0.167077 Nov 02 12:52:38.513914 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 10/24] 10.222.0.90 () {58 vars in 1254 bytes} [Wed Nov 2 12:52:38 2022] DELETE /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:38.522311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bea169d6-54c1-4992-92f0-ad21f0420539 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443c34c0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:38.622887 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bea169d6-54c1-4992-92f0-ad21f0420539 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.104591 Nov 02 12:52:38.623449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 11/25] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:38 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:39.121050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e9bf0b4-341e-4ddc-9840-f743ae951bbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'create', calling method: .version_select at 0x7fbe443b3e50>, body: {"keypair": {"name": "tempest-keypair-1258155672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPqG2vypTi7T4Gki+28d+XlcEmar8+QkGuY2LRAS8bnaNb36Ehf70wyaXxgZ3NmFFRzRhQv18S28Ujz6BjQGvEhWhTp1wGHFlGNYKD/TyJiR67gyPuaH5fzAMBdh9GQ3A=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:39.189501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-5e9bf0b4-341e-4ddc-9840-f743ae951bbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:39.210223 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-5e9bf0b4-341e-4ddc-9840-f743ae951bbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for user a2c786462bac45848eeff3a966e71149 and project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:39.374728 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e9bf0b4-341e-4ddc-9840-f743ae951bbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.913739 Nov 02 12:52:39.383748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 15/26] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Nov 2 12:52:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 916 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:52:39.636106 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-372ccccb-1e40-4f9a-95b3-3c2dabecd7b6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe44422ee0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:39.680420 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-372ccccb-1e40-4f9a-95b3-3c2dabecd7b6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.048751 Nov 02 12:52:39.681677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 12/27] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:39 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:39.942071 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1819589744", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "networks": [{"uuid": "60d337b4-4ca8-43ed-afc1-671fbf50993a"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:40.119177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] validate_networks() for [('60d337b4-4ca8-43ed-afc1-671fbf50993a', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:52:40.694759 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7be674d9-c18f-4598-b6b9-e05d422a5e74 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b6670>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:40.769745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7be674d9-c18f-4598-b6b9-e05d422a5e74 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.078853 Nov 02 12:52:40.770657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 13/28] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:40 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:41.783869 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4c76b720-d237-4498-927e-325e0daae5ac tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe443b6af0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:41.859510 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4c76b720-d237-4498-927e-325e0daae5ac tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 200 len: 287 microversion: 2.1 time: 0.080099 Nov 02 12:52:41.860824 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 14/29] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:41 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:42.064348 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:42.064935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:42.065310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:42.065642 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:42.071741 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:42.093487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:42.095222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:42.097687 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:42.099680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:42.190170 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Getting quotas for project 7d2c4b25d8f447e99927fa32e9f35b1a. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:42.215579 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Getting quotas for user fd0b35be3944451d961e68ed1e39afc2 and project 7d2c4b25d8f447e99927fa32e9f35b1a. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:42.269863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:52:42.286340 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:52:42.491349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-49aa47f9-af77-484d-992b-de29350dfd18 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.748868 Nov 02 12:52:42.492864 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 16/30] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:52:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:52:42.513148 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-616a43f4-7566-43bc-a0da-ed88c7b989a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:42.515719 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-616a43f4-7566-43bc-a0da-ed88c7b989a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:42.730452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-97f5376c-acf7-441e-b0f0-199bd7d66b62 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'create', calling method: .version_select at 0x7fbe443c35e0>, body: {"keypair": {"name": "tempest-keypair-273704677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuLm7big4hMuZaukwefcX2Rwfe/3F8HTvXeKONl2/IzgrF+KmSat8F33UXXGLVEb4MMD3xfGsHadKZuNU7bYWaL4BjrbB8fIxntUaY34VYGwru7fBLbFeBIDfY5kaoPkg=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:42.843111 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-616a43f4-7566-43bc-a0da-ed88c7b989a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:42.898507 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-97f5376c-acf7-441e-b0f0-199bd7d66b62 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:42.925925 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-616a43f4-7566-43bc-a0da-ed88c7b989a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1215 microversion: 2.1 time: 0.424402 Nov 02 12:52:42.929367 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 17/31] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:42 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1215 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:42.935163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-97f5376c-acf7-441e-b0f0-199bd7d66b62 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for user 3a45298a10af4fc3991887cb4da55e86 and project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:43.084266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-97f5376c-acf7-441e-b0f0-199bd7d66b62 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.724301 Nov 02 12:52:43.095535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-537769225", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:43.098934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 15/32] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 12:52:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:43.131998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c3c9b2d6-c4b5-44d8-b8dc-67ac2d91f6b2 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe43b451f0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:43.260107 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] validate_networks() for [('44813eaf-ef4c-426e-8812-9534d97c5b8a', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:52:43.348390 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-c3c9b2d6-c4b5-44d8-b8dc-67ac2d91f6b2 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] HTTP exception thrown: Snapshot df915b29-c2b3-4cba-b6d1-3ae105de3f96 could not be found. Nov 02 12:52:43.350151 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c3c9b2d6-c4b5-44d8-b8dc-67ac2d91f6b2 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Returning 404 to user: Snapshot df915b29-c2b3-4cba-b6d1-3ae105de3f96 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:43.351405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c3c9b2d6-c4b5-44d8-b8dc-67ac2d91f6b2 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96" status: 404 len: 111 microversion: 2.1 time: 0.240688 Nov 02 12:52:43.355748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 16/33] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 12:52:43 2022] GET /compute/v2.1/os-snapshots/df915b29-c2b3-4cba-b6d1-3ae105de3f96 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:43.367462 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5b3d54ff-5d52-42a5-b9a6-2b117754105b tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe43b45e50>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:43.655910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5b3d54ff-5d52-42a5-b9a6-2b117754105b tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 202 len: 0 microversion: 2.1 time: 0.298475 Nov 02 12:52:43.660405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 17/34] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 12:52:43 2022] DELETE /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:43.679648 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-64c89732-f5de-4f15-b116-1117a0232c47 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe43b45940>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:43.828307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-64c89732-f5de-4f15-b116-1117a0232c47 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 200 len: 344 microversion: 2.1 time: 0.156785 Nov 02 12:52:43.828976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 18/35] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:43 2022] GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:43.955954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-51b82da6-8487-43a3-af86-bb7632ea682c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:43.956678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-51b82da6-8487-43a3-af86-bb7632ea682c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:44.265590 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-51b82da6-8487-43a3-af86-bb7632ea682c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:44.298401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-51b82da6-8487-43a3-af86-bb7632ea682c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1215 microversion: 2.1 time: 0.346484 Nov 02 12:52:44.301446 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 19/36] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:43 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:44.845905 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-64f2a68b-65d4-4c9f-b766-c8ee45ea51e4 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe43ae73a0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:45.028682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-64f2a68b-65d4-4c9f-b766-c8ee45ea51e4 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] HTTP exception thrown: Volume 1cb20f25-d255-44ad-8e74-a710626052f8 could not be found. Nov 02 12:52:45.030344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-64f2a68b-65d4-4c9f-b766-c8ee45ea51e4 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Returning 404 to user: Volume 1cb20f25-d255-44ad-8e74-a710626052f8 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:45.032281 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-64f2a68b-65d4-4c9f-b766-c8ee45ea51e4 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 404 len: 109 microversion: 2.1 time: 0.192583 Nov 02 12:52:45.033604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 20/37] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:44 2022] GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:45.059479 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1982533082", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c790846-1155-4e44-80f1-15983b65a735"}], "security_groups": [{"name": "tempest-securitygroup--1032031682"}], "key_name": "tempest-keypair-1258155672", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:45.549050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] validate_networks() for [('5c790846-1155-4e44-80f1-15983b65a735', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:52:45.553409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:45.553856 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:45.554930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:45.555482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:45.555906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:45.575000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:45.575522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:45.577628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:45.578115 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:45.630072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:45.639217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for user 12d35ac129c24e118df9ebee0c8c9f6f and project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:45.674740 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:52:45.677921 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:52:45.793601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ac9c0985-215d-4525-b59f-c0cb3ac3137d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.862476 Nov 02 12:52:45.795374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 18/38] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:52:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:52:45.800237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d8fee3c1-0f39-4903-94fe-dcc7eafa8ac6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe43a9f8b0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:46.010396 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-d8fee3c1-0f39-4903-94fe-dcc7eafa8ac6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] HTTP exception thrown: Volume 1cb20f25-d255-44ad-8e74-a710626052f8 could not be found. Nov 02 12:52:46.011650 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d8fee3c1-0f39-4903-94fe-dcc7eafa8ac6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Returning 404 to user: Volume 1cb20f25-d255-44ad-8e74-a710626052f8 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:46.012693 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d8fee3c1-0f39-4903-94fe-dcc7eafa8ac6 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 404 len: 109 microversion: 2.1 time: 0.216237 Nov 02 12:52:46.013529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 19/39] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 12:52:45 2022] DELETE /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:46.018822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:46.019621 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:46.042458 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:46.044351 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:46.049044 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:46.049711 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:46.521206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:46.554501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-71cddd36-63a0-41f0-b121-16d24299788b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1267 microversion: 2.1 time: 0.539460 Nov 02 12:52:46.555059 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 20/40] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:46 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1267 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:46.567814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f909ad46-1599-4e8a-9d94-6cd706ed35ee tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:46.578484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f909ad46-1599-4e8a-9d94-6cd706ed35ee tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:46.824157 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f909ad46-1599-4e8a-9d94-6cd706ed35ee tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:46.846406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f909ad46-1599-4e8a-9d94-6cd706ed35ee tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1221 microversion: 2.1 time: 0.282582 Nov 02 12:52:46.847015 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 21/41] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:46 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1221 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:46.876651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-410c317f-25e1-4726-93cc-a997aed142e1 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Calling method '.version_select at 0x7fbe429bb700>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:47.002457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-410c317f-25e1-4726-93cc-a997aed142e1 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] HTTP exception thrown: Volume 1cb20f25-d255-44ad-8e74-a710626052f8 could not be found. Nov 02 12:52:47.003317 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-410c317f-25e1-4726-93cc-a997aed142e1 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] Returning 404 to user: Volume 1cb20f25-d255-44ad-8e74-a710626052f8 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:52:47.004362 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-410c317f-25e1-4726-93cc-a997aed142e1 tempest-VolumesSnapshotsTestJSON-703902300 tempest-VolumesSnapshotsTestJSON-703902300-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8" status: 404 len: 109 microversion: 2.1 time: 0.156401 Nov 02 12:52:47.005193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 22/42] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:46 2022] GET /compute/v2.1/os-volumes/1cb20f25-d255-44ad-8e74-a710626052f8 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:47.143385 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-650758853", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:47.308103 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] validate_networks() for [('44813eaf-ef4c-426e-8812-9534d97c5b8a', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:52:48.950254 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:48.952547 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:48.954407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:48.956070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:48.956672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:48.995277 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:48.996330 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:49.000379 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:49.001694 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:49.104562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:49.123405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for user a2c786462bac45848eeff3a966e71149 and project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:49.177472 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:52:49.194266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:52:49.531417 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d0fe9e43-8243-42eb-9a7a-5e194c719708 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.495638 Nov 02 12:52:49.534666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 21/43] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Nov 2 12:52:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 4500 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:52:49.548167 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:49.562751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:49.583903 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:49.584358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:49.586239 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:49.588739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:49.766729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:49.767163 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:49.769578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:49.770006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:49.770434 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:49.785831 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:49.786299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:49.788117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:49.788635 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:50.267946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:50.300086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c50c8592-74fd-4f04-b7a0-99e8d475eda7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.760220 Nov 02 12:52:50.308054 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 22/44] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:49 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:50.331597 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1583848191", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1899e874-a496-4913-9de6-503fed5c449b"}], "security_groups": [{"name": "tempest-securitygroup--1145855199"}], "key_name": "tempest-keypair-273704677", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:50.408865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:50.420725 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for user 12d35ac129c24e118df9ebee0c8c9f6f and project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:50.460453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:52:50.463468 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:52:50.615641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-29043af2-cda2-4c7c-b0fb-47715ca17c49 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.484782 Nov 02 12:52:50.618943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 23/45] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:52:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 3492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:52:50.660121 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7c0fb595-d8fb-4ff3-b632-5f8317dd84e9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:50.663267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7c0fb595-d8fb-4ff3-b632-5f8317dd84e9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:51.164468 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7c0fb595-d8fb-4ff3-b632-5f8317dd84e9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:51.182236 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7c0fb595-d8fb-4ff3-b632-5f8317dd84e9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:51.189836 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7c0fb595-d8fb-4ff3-b632-5f8317dd84e9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:51.193055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7c0fb595-d8fb-4ff3-b632-5f8317dd84e9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1282 microversion: 2.20 time: 0.571472 Nov 02 12:52:51.196379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 24/46] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:50 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1282 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:51.219653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3a3acc4f-2652-4d97-9fd4-fba31528ca1c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:51.222147 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3a3acc4f-2652-4d97-9fd4-fba31528ca1c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:51.514143 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] validate_networks() for [('1899e874-a496-4913-9de6-503fed5c449b', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:52:51.594146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3a3acc4f-2652-4d97-9fd4-fba31528ca1c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:51.612355 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3a3acc4f-2652-4d97-9fd4-fba31528ca1c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1221 microversion: 2.1 time: 0.414471 Nov 02 12:52:51.613856 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 25/47] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:51 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1221 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:51.651301 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:51.659151 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:51.691977 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:51.695188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:51.699793 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:51.702605 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:53.116192 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:53.116681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:53.117172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:53.117924 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:53.118553 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:53.161851 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:53.171702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:53.174324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:53.179231 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:53.275426 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:53.295948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for user 3a45298a10af4fc3991887cb4da55e86 and project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:53.333170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:52:53.337982 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:52:53.459910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-65f9dcb4-1e03-4ef3-9a8d-1512270633bb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.148020 Nov 02 12:52:53.471708 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 23/48] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:52:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 3163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:52:53.482186 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:53.483138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:53.493542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:53.512448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:53.524936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:53.525656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:53.815940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:53.846820 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:53.856310 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:53.862091 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5fca051e-5d24-4aa7-9ba1-46ad8e4e311c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1340 microversion: 2.20 time: 0.387565 Nov 02 12:52:53.886380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:53 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1340 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:53.908997 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:53.910695 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:53.934739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:53.935375 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:53.936229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:53.943673 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:54.251504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:54.282474 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5155444c-4337-4862-b885-f1a45f901d2a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1281 microversion: 2.1 time: 0.391961 Nov 02 12:52:54.292009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 25/50] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:53 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1281 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:54.321551 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7ebf1ed7-9e17-493b-8615-8e243f3b3030 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:54.322235 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7ebf1ed7-9e17-493b-8615-8e243f3b3030 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:54.635801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7ebf1ed7-9e17-493b-8615-8e243f3b3030 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:54.650558 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7ebf1ed7-9e17-493b-8615-8e243f3b3030 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1237 microversion: 2.1 time: 0.349360 Nov 02 12:52:54.680429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 26/51] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:54 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1237 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:54.920983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:54.923057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:54.948475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:54.957871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:54.957871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:54.957871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:55.188994 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:55.206015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:55.207703 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:55.208901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-674157c8-cfa3-43ff-a5b4-6ecc984768cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1340 microversion: 2.20 time: 0.313400 Nov 02 12:52:55.228035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 27/52] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:54 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1340 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:55.339638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:55.340346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:55.350341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:55.350801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:55.351639 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:55.352342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:55.542381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:55.554574 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd735ee0-875d-470f-9689-56f1ff145943 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 3.934684 Nov 02 12:52:55.555197 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 26/53] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:51 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 3938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:55.592508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:55.607555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8bd88475-8f7e-4941-8fd0-efeb56261a7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1279 microversion: 2.1 time: 0.285716 Nov 02 12:52:55.612273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 28/54] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:55 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1279 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:55.711183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:55.713780 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:55.735321 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:55.737107 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:55.741954 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:55.749236 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:56.238737 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:56.239364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:56.247335 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:56.253784 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:56.255030 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:56.255541 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:56.376720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:56.402887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-284c048d-9478-4750-86d6-7e4be64e8945 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1289 microversion: 2.1 time: 0.693116 Nov 02 12:52:56.404290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 27/55] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:55 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1289 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:56.449078 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:56.460891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:56.463815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:56.470911 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4477c61c-1707-4376-9858-f54f55abcc75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1340 microversion: 2.20 time: 0.236618 Nov 02 12:52:56.474242 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 29/56] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:56 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1340 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:52:56.585808 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:56.586629 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:56.610190 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:56.611610 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:56.615692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:56.619537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:56.637555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:56.638672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:56.670202 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:56.671162 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:56.679404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:56.680781 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:56.879826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:56.888789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-da6debd3-8cc2-4560-adff-5e609c788721 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1279 microversion: 2.1 time: 0.256258 Nov 02 12:52:56.893560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 30/57] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:56 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:57.433778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:57.434693 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:57.451323 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:57.452058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:57.455376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:57.457323 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:57.601958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:57.610712 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4bfa70bc-f0bc-41f1-b104-a7ccb9144bea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.182214 Nov 02 12:52:57.611350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 31/58] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:57 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:57.619451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:57.633335 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:57.641855 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:57.644758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:57.646044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:57.652995 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:57.789643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:57.800284 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:57.802554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:57.804650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-79485787-087c-472e-8082-fea656bdc894 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1340 microversion: 2.20 time: 0.189017 Nov 02 12:52:57.806312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 32/59] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:57 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1340 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:57.927654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:57.928131 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:57.946364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:57.947014 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:57.947867 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:57.948376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:58.109562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:58.124191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a0fec412-c432-4e10-b764-ec947e7c305c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1279 microversion: 2.1 time: 0.205259 Nov 02 12:52:58.147766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 33/60] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:57 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:58.640381 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:58.642923 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:58.662076 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:58.664248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:58.669429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:58.671530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:58.778795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:58.793244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c4231ae3-8490-4a12-8c6f-8ad2260846f1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.159953 Nov 02 12:52:58.807040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 34/61] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:58 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:59.014696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:59.026125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5d856ae2-801a-479b-a554-291be5b84581 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 2.446024 Nov 02 12:52:59.032367 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 28/62] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:56 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:59.045382 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:59.046455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:59.062155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.062854 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.063864 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.074177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.083857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-07a1e4b5-d1b6-421a-8204-e4e9df91db99 req-e42a65fb-a6ec-49b0-b847-73852e50ffc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "980d235a-d1e0-4688-97c4-2e18bb50b977", "tag": "2059fb0f-4225-4fc2-af2b-4a514fca1328"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:59.115376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-07a1e4b5-d1b6-421a-8204-e4e9df91db99 req-e42a65fb-a6ec-49b0-b847-73852e50ffc3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.119684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-07a1e4b5-d1b6-421a-8204-e4e9df91db99 req-e42a65fb-a6ec-49b0-b847-73852e50ffc3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.192730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-07a1e4b5-d1b6-421a-8204-e4e9df91db99 req-e42a65fb-a6ec-49b0-b847-73852e50ffc3 service nova] Creating event network-changed:2059fb0f-4225-4fc2-af2b-4a514fca1328 for instance 980d235a-d1e0-4688-97c4-2e18bb50b977 on hv-cinder-86327 Nov 02 12:52:59.193657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-07a1e4b5-d1b6-421a-8204-e4e9df91db99 req-e42a65fb-a6ec-49b0-b847-73852e50ffc3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 02 12:52:59.195080 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe19e0-0b1f-48a1-b219-5a4064dc41bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.195763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe19e0-0b1f-48a1-b219-5a4064dc41bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.208120 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe19e0-0b1f-48a1-b219-5a4064dc41bf None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.208931 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe19e0-0b1f-48a1-b219-5a4064dc41bf None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.219888 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.compute.rpcapi [None req-f6fe19e0-0b1f-48a1-b219-5a4064dc41bf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Nov 02 12:52:59.221156 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe19e0-0b1f-48a1-b219-5a4064dc41bf None None] Releasing lock "compute-rpcapi-router" {{(pid=124277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:52:59.251276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f6fe19e0-0b1f-48a1-b219-5a4064dc41bf None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.443201 Nov 02 12:52:59.252313 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 35/63] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:59.257936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:59.258986 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:59.276040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.280137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.281460 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.282336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.392897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:59.395403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:59.412896 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d8797a5f-f018-4083-a0d2-150131edb1ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1279 microversion: 2.1 time: 0.158767 Nov 02 12:52:59.417341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 36/64] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:59 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:59.419675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:59.426490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:59.427939 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cc004b56-ddf5-492b-8532-16474350e248 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1340 microversion: 2.20 time: 0.392441 Nov 02 12:52:59.444676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 29/65] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:52:59 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1340 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:52:59.822117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:59.823912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:52:59.841876 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.842651 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:52:59.849680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:52:59.850799 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:00.020050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:00.026023 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a1067db1-d1a7-425c-aa69-89a72b3cdd0b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.208976 Nov 02 12:53:00.043537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 37/66] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:59 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:00.058042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:00.058657 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:00.068630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:00.071605 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:00.073268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:00.073880 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:00.445981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:00.446937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:00.459522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:00.464066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:00.465387 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:00.466052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:00.610175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:00.620706 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c60f9261-fe81-44b8-b24f-33d9ceba6588 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1279 microversion: 2.1 time: 0.178755 Nov 02 12:53:00.636961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 38/67] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:00 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:00.645949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:00.647291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:00.654597 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:00.655440 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:00.656594 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:00.657583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:00.770940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:00.789643 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-071d63cc-9eca-45fa-ba4e-b62a8fe4acfa tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.733576 Nov 02 12:53:00.794792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 30/68] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:00 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:01.017196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:01.030224 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:01.052599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:01.054586 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f8286bde-9f43-4029-a227-d4a5bb9354e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.416089 Nov 02 12:53:01.059360 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 39/69] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:00 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:01.073957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:01.074886 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:01.091673 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:01.092136 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:01.102498 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:01.104507 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:01.411834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:01.426109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d4e0b6c4-1e28-4476-81d2-83317648da6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.375905 Nov 02 12:53:01.437329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 31/70] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:01 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:01.651295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:01.652565 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:01.670107 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:01.671771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:01.672843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:01.673485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:01.822664 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:01.824089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:01.832327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:01.833181 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:01.834882 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:01.835933 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:01.965266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:01.973758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f35c3143-2722-4f9e-be1c-0f4d9698e4f8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.326390 Nov 02 12:53:01.975544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 40/71] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:01 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:01.981025 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-a06e98c4-da25-495b-805b-1359c9e18ba2 req-75040a5f-8152-4630-ab7d-4e4ea4cb2916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d7f87e-6c63-40ee-9bf3-e454b81d34ee", "tag": "77048807-cd5e-48b1-8d83-bf09988266df"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:01.989310 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-a06e98c4-da25-495b-805b-1359c9e18ba2 req-75040a5f-8152-4630-ab7d-4e4ea4cb2916 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:01.990279 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-a06e98c4-da25-495b-805b-1359c9e18ba2 req-75040a5f-8152-4630-ab7d-4e4ea4cb2916 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:02.004938 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-a06e98c4-da25-495b-805b-1359c9e18ba2 req-75040a5f-8152-4630-ab7d-4e4ea4cb2916 service nova] Creating event network-changed:77048807-cd5e-48b1-8d83-bf09988266df for instance 28d7f87e-6c63-40ee-9bf3-e454b81d34ee on hv-cinder-86327 Nov 02 12:53:02.011750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-a06e98c4-da25-495b-805b-1359c9e18ba2 req-75040a5f-8152-4630-ab7d-4e4ea4cb2916 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034354 Nov 02 12:53:02.013090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 41/72] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:02.091205 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:02.091920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:02.101762 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:02.113570 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e4ba261-7830-405d-b2cb-f3a23e8d0dea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.295250 Nov 02 12:53:02.115607 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 32/73] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:01 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:02.117506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:02.117976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:02.118787 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:02.119229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:02.281750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:02.293678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:02.295174 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:02.296305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c19eb6a3-7aac-4ace-8876-d275ce7c9cc7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.210203 Nov 02 12:53:02.297216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 42/74] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:02 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:02.451493 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:02.452235 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:02.458785 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:02.459265 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:02.460031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:02.460500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:02.523213 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:02.531208 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-94002ef7-e1b1-4897-b92d-875b74dde787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.083910 Nov 02 12:53:02.531787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 33/75] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:02 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:02.999115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:02.999753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:03.005812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.006261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.007024 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.007462 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.138318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:03.139833 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:03.146273 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.147125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.147912 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.148065 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.148531 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.156903 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-73442802-70a4-4e3f-b6d8-0d35ff04d6e6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.161788 Nov 02 12:53:03.157721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 43/76] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:02 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:03.319572 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.326760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:03.327644 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:03.329115 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-09bfe4d0-7588-47de-a2cb-ada0e8fa3812 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.194626 Nov 02 12:53:03.329784 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 34/77] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:03 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:03.352593 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.353543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.354573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.359575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.555184 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:03.556177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:03.562787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.563530 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.564554 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:03.564731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.565390 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:03.576934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.579628 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.581498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-83d2a937-c0fa-4773-b80b-04fb33022b90 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.261670 Nov 02 12:53:03.582193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 44/78] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:03 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:03.647602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:03.661532 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a40fc8a9-a22c-4772-92a2-f33171a2e5a4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.110327 Nov 02 12:53:03.662185 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 35/79] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:03 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:04.181421 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.182051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:04.191562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.192115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:04.194250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.194817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:04.359335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.360923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:04.372003 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.372660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:04.373646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.374250 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:04.563656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:04.572641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-90ddd4bd-65fe-4116-9b37-120b58d58149 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.395509 Nov 02 12:53:04.573230 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 45/80] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:04 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:04.607255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.607861 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:04.614244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.614755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:04.615640 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.616140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:04.889460 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:04.902845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:04.904425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:04.924297 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cb51db1b-c259-49e1-9462-54b0f845e6fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.320822 Nov 02 12:53:04.925699 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 46/81] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:04 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:04.933441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:04.934075 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:04.958890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.959350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:04.960248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:04.960681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:05.059706 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:05.067657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bc0d4f85-88b6-4b03-9d8c-1b860d458b3b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.140858 Nov 02 12:53:05.071063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 47/82] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:04 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:05.467970 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:05.480415 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c70b7909-21c7-4a54-86f4-9cefabec8fc2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 1.128834 Nov 02 12:53:05.481601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 36/83] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:04 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:05.596168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:05.596802 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:05.604513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:05.605079 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:05.606494 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:05.607639 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:05.956410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:05.957177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:05.965009 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:05.965792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:05.967005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:05.968761 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:05.970911 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:05.987204 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3829e9f1-2e17-45e7-a0af-6e55c9d446c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.394148 Nov 02 12:53:05.989625 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 48/84] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:05 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:06.093393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:06.094013 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:06.101489 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:06.102346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:06.103975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:06.104736 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:06.193302 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:06.207837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8f885db7-a38b-4faa-9cee-4b86f40068e4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1295 microversion: 2.1 time: 0.115966 Nov 02 12:53:06.209792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 49/85] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:06 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:06.363044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-c84abfed-6ae4-4159-94ab-e88ddfb9d6e9 req-2d8ac6be-9046-44e4-ac9d-396cd1f1556d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d458f0b-437a-41ff-93f3-1091857b39c8", "tag": "ceff5860-04fb-4226-b8ae-37c3cb9c96be"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:06.375158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c84abfed-6ae4-4159-94ab-e88ddfb9d6e9 req-2d8ac6be-9046-44e4-ac9d-396cd1f1556d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:06.375593 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c84abfed-6ae4-4159-94ab-e88ddfb9d6e9 req-2d8ac6be-9046-44e4-ac9d-396cd1f1556d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:06.401796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-c84abfed-6ae4-4159-94ab-e88ddfb9d6e9 req-2d8ac6be-9046-44e4-ac9d-396cd1f1556d service nova] Creating event network-changed:ceff5860-04fb-4226-b8ae-37c3cb9c96be for instance 8d458f0b-437a-41ff-93f3-1091857b39c8 on hv-cinder-86327 Nov 02 12:53:06.407521 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-c84abfed-6ae4-4159-94ab-e88ddfb9d6e9 req-2d8ac6be-9046-44e4-ac9d-396cd1f1556d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047987 Nov 02 12:53:06.408909 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 50/86] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:53:06.501893 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:06.505418 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:06.506306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:06.517935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:06.524184 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:06.525821 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6d661631-fcde-426b-80ed-2649ae340704 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.577056 Nov 02 12:53:06.526212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 37/87] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:05 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:06.558189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:06.558675 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:06.559471 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:06.559910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:06.728737 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:06.737531 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-685f2056-929e-464d-8160-8ca749f0fd9b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.237639 Nov 02 12:53:06.738234 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 51/88] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:06 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:07.015528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:07.016257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:07.027678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.030555 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.031857 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.032560 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.204594 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:07.216495 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2ed2f6da-4da0-4f97-9d72-6a4b67455d24 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.205228 Nov 02 12:53:07.217088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 38/89] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:07 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:07.235823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:07.236693 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:07.243856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.244342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.245161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.245904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.404340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:07.412908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b6a2d716-d888-4189-a11d-7075e0d16013 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.181223 Nov 02 12:53:07.413732 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 52/90] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:07 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:07.554571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:07.555475 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:07.564732 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.565033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.567866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.568505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.764153 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:07.765505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:07.776089 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.777044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.778021 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:07.779518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:07.809985 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:07.820575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:07.822131 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:07.823279 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-28f0bf24-3395-488f-9cb8-be7cd5608865 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.273740 Nov 02 12:53:07.826565 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 39/91] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:07 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:07.952982 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:07.962390 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-321a79ef-a80c-4e19-983b-cbbdafa7a777 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.204885 Nov 02 12:53:07.963348 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 53/92] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:07 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:08.239823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:08.240698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:08.247703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:08.248424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:08.249747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:08.250395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:08.440683 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:08.441344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:08.448489 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:08.448958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:08.449774 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:08.450209 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:08.668888 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:08.690355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ab88c4f0-42ba-4357-a03e-12a02f44b773 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.255577 Nov 02 12:53:08.694248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 54/93] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:08 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:08.705915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-58823b94-0e7d-49eb-915a-43fc82bec36f req-936b45c0-c37a-46ec-a9cf-5bc949590b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1839881d-97b0-4aa7-b398-2eeee344099f", "tag": "7a7f193c-8f61-4df5-8e3c-0d69f95daa2f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:08.720802 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-58823b94-0e7d-49eb-915a-43fc82bec36f req-936b45c0-c37a-46ec-a9cf-5bc949590b44 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:08.721477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-58823b94-0e7d-49eb-915a-43fc82bec36f req-936b45c0-c37a-46ec-a9cf-5bc949590b44 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:08.734771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-58823b94-0e7d-49eb-915a-43fc82bec36f req-936b45c0-c37a-46ec-a9cf-5bc949590b44 service nova] Creating event network-changed:7a7f193c-8f61-4df5-8e3c-0d69f95daa2f for instance 1839881d-97b0-4aa7-b398-2eeee344099f on hv-cinder-86327 Nov 02 12:53:08.740227 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-58823b94-0e7d-49eb-915a-43fc82bec36f req-936b45c0-c37a-46ec-a9cf-5bc949590b44 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044127 Nov 02 12:53:08.741396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 55/94] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:08.854442 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:08.855276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:08.862705 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:08.863401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:08.864534 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:08.865149 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:09.099267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:09.112810 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b438dc4b-c452-45ea-9baa-c24af0c2caf2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.875963 Nov 02 12:53:09.126413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 40/95] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:08 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:09.145157 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:09.145794 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:09.158898 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:09.159341 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:09.161832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:09.168255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:09.202764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:09.216812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:09.219329 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:09.220940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-97e93193-ceb3-4e49-b1e9-9d8d737c727f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.372234 Nov 02 12:53:09.223271 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 56/96] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:08 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:09.452905 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:09.462905 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-84c69de2-a3d1-4e92-9dff-956716258fea tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.328438 Nov 02 12:53:09.478459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 41/97] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:09 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:09.720305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:09.721129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:09.727443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:09.727904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:09.728895 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:09.729230 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:09.907557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:09.916737 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-766cb9a4-3727-4f2a-a7a9-c47907854978 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.200294 Nov 02 12:53:09.928702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 57/98] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:09 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:10.140906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:10.141509 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:10.149037 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.150126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.151435 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.152524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.251268 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:10.251889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:10.258440 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.259261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.260235 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.261294 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.320184 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:10.328917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2a289101-4b6e-47e6-85a6-025a39349cf1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.192264 Nov 02 12:53:10.329842 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 42/99] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:10 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:10.415307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:10.426266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:10.426266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:10.426654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d4b40081-5cde-4f42-bdbc-093f21d1eb12 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.179520 Nov 02 12:53:10.427210 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 58/100] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:10 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:10.490058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:10.490814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:10.503512 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.504173 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.505101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.505672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.648448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:10.656302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-789f482d-befe-46a6-87cd-69deb7b13987 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.170279 Nov 02 12:53:10.665998 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 43/101] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:10 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:10.793064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-fe3ee504-7a18-48af-b251-076e7f867c44 req-9b375dbf-742a-41eb-9857-f3c9ce61dc9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe9d261-592b-4b69-944d-5517465f6c40", "tag": "6f41fdae-476d-4c30-ba0a-43899e265ad5"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:10.801508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-fe3ee504-7a18-48af-b251-076e7f867c44 req-9b375dbf-742a-41eb-9857-f3c9ce61dc9e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.802165 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-fe3ee504-7a18-48af-b251-076e7f867c44 req-9b375dbf-742a-41eb-9857-f3c9ce61dc9e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.814498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-fe3ee504-7a18-48af-b251-076e7f867c44 req-9b375dbf-742a-41eb-9857-f3c9ce61dc9e service nova] Creating event network-changed:6f41fdae-476d-4c30-ba0a-43899e265ad5 for instance ebe9d261-592b-4b69-944d-5517465f6c40 on hv-cinder-86327 Nov 02 12:53:10.819584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-fe3ee504-7a18-48af-b251-076e7f867c44 req-9b375dbf-742a-41eb-9857-f3c9ce61dc9e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030347 Nov 02 12:53:10.826985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 59/102] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:10.942618 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:10.943501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:10.950425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.950980 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:10.951841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:10.952386 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:11.175454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:11.184243 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-25a03afa-9e35-46f2-ba33-1ae912b61888 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.245270 Nov 02 12:53:11.196809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 44/103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:10 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:11.353352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:11.354099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:11.361541 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:11.361986 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:11.362764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:11.363191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:11.452079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:11.452743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:11.459265 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:11.459776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:11.460851 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:11.461794 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:11.509641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:11.517935 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3478dabe-f00f-4c13-b6d1-136f2ed4fb29 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.169043 Nov 02 12:53:11.518517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 60/104] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:11 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:11.607582 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:11.615957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:11.617945 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:11.619144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9bed63a4-b8ca-4508-bce4-05d684fe2999 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.171146 Nov 02 12:53:11.620111 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 45/105] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:11 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:11.680601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:11.681291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:11.687727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:11.688395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:11.689173 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:11.689611 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:11.829967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:11.837358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b748d28a-2ba1-48ee-8054-eb67c853dcd7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.161003 Nov 02 12:53:11.837981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 61/106] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:11 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:12.213924 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:12.214669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:12.220909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.221455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:12.222230 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.222662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:12.377849 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:12.385843 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0a31f880-6941-4ed5-8e8a-521cb122cb8e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.182806 Nov 02 12:53:12.386576 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 46/107] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:12 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:12.542993 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:12.543669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:12.549958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.550398 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:12.551165 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.551589 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:12.644580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:12.645195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:12.651949 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.652468 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:12.653281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.653719 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:12.691130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:12.699128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-664e6303-2b99-4f1a-9e91-88e5a1d73705 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.160120 Nov 02 12:53:12.700009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 62/108] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:12 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:12.860095 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:12.860727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:12.867614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.868006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:12.868909 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:12.869297 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:13.000016 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.009542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.011084 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.012228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d1f85cd9-2cd2-4ac1-ac2c-369ea6c860e3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.371641 Nov 02 12:53:13.028610 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 47/109] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:12 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:13.035943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.043957 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f356f582-1dcd-4db2-9545-34f54d7ab56d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.187715 Nov 02 12:53:13.044669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 63/110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:12 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:13.408412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:13.409535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:13.416558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:13.417942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:13.418923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:13.419494 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:13.623807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.633614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-86668d2d-e30d-48e9-81b0-34dd0d24e1fc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.227803 Nov 02 12:53:13.634316 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 48/111] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:13 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:13.724069 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:13.724947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:13.734571 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:13.735443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:13.736443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:13.737341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:13.908628 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.917938 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-606660db-9819-4936-aa59-7e6a3aea68c2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.198152 Nov 02 12:53:13.932856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 64/112] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:13 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:14.039370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:14.040348 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:14.047490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.048192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:14.049150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.049732 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:14.068308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:14.069184 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:14.081935 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.082620 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:14.083637 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.084242 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:14.245001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:14.252985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b0b731ee-eec0-4f86-bc6c-661d82cf678d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.188970 Nov 02 12:53:14.253652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 65/113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:14 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:14.657614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:14.658306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:14.665626 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.666080 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:14.666949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.667468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:14.747132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:14.759008 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:14.763085 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:14.764699 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e7baa67d-f075-42cf-b1b4-02056e60db8f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.729573 Nov 02 12:53:14.778320 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 49/114] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:14 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:14.832676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:14.842325 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-792d3372-ce07-458a-970e-9b73abbfcee9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.188828 Nov 02 12:53:14.843535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 66/115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:14 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:14.942942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:14.943734 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:14.951338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.952001 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:14.953072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:14.953677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:15.277410 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.278258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:15.284718 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:15.285165 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:15.285945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:15.286368 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:15.314111 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:15.326863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6e9a8f38-52ae-4d0d-9767-3dbc7bc80d87 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.388220 Nov 02 12:53:15.327977 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 50/116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:14 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:15.431247 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:15.440650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-445dd707-46cb-40de-9b39-9c1d99ad19a9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.167595 Nov 02 12:53:15.442030 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 67/117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:15 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:15.801124 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.802021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:15.808748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:15.809534 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:15.810594 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:15.811131 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:15.870653 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.871419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:15.877710 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:15.878299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:15.879180 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:15.879720 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:16.039881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.053510 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4dd942d9-ff35-4d3f-86d6-d1397e8600d3 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.186876 Nov 02 12:53:16.055555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 68/118] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:15 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:16.175341 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.185047 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.192500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.193758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7e2761d7-d96b-41cc-a04d-337b0ba36920 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.403049 Nov 02 12:53:16.194677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 51/119] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:15 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:16.351170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:16.352341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:16.361809 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:16.362362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:16.363369 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:16.364384 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:16.467000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:16.467709 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:16.478427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:16.478865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:16.479745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:16.480186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:16.572395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.583786 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d9341eb2-f81e-4518-8118-26522706dcbd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.237818 Nov 02 12:53:16.586651 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 69/120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:16 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:16.688265 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.696621 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9304f764-c355-483b-855e-52e66ea7a809 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.234703 Nov 02 12:53:16.697609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 52/121] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:16 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:17.083485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:17.084127 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:17.090878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.091319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.092083 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.092554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.218726 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:17.219333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:17.225558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.226009 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.226791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.227221 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.240493 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:17.248158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b9ea3f43-4e84-4c06-867f-e10ebac0171e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.168710 Nov 02 12:53:17.248778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 70/122] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:17 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:17.382008 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:17.390430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:17.391952 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:17.393120 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ec854bfa-db1b-4f39-a932-8c7260c7d626 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.178672 Nov 02 12:53:17.393680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 53/123] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:17 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:17.615548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:17.615548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:17.621120 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.621996 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.622967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.623936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.719691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:17.720430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:17.727041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.728365 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.729318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:17.730113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:17.776231 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:17.785006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4e2d80c8-a5fa-442d-a864-516108a9480a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.178535 Nov 02 12:53:17.785773 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 71/124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:17 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:17.901991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:17.913091 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-06be7f66-bdea-4f7f-91f8-393cdc9d2d42 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.197666 Nov 02 12:53:17.914308 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 54/125] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:17 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:18.273583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:18.274453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:18.280825 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.281346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.282308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.282735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.419405 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:18.420002 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:18.428869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.429708 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:18.430251 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.433226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.434413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.438600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a0fd2ae6-a541-4ede-a414-bbb5d4c51d60 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.170880 Nov 02 12:53:18.454194 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 72/126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:18 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:18.611580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:18.619928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:18.621519 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:18.622681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c79be887-e843-4bb2-9444-9f73884c0ca7 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.207423 Nov 02 12:53:18.623234 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 55/127] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:18 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:18.808502 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:18.809269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:18.815460 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.815992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.816867 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.817344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.937072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:18.937691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:18.945794 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.946212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.947034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:18.947442 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:18.977573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:18.986611 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7762cb71-662a-46fa-89a7-8f0837f32d16 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.182161 Nov 02 12:53:18.987697 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 73/128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:18 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:19.113383 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:19.122687 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-217ebcb3-02f0-49bf-a10d-cb7b6275a0f5 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.189420 Nov 02 12:53:19.123807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 56/129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:18 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:19.480946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:19.481673 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:19.492511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:19.494392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:19.495258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:19.498159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:19.649925 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:19.650564 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:19.657278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:19.667084 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:19.667084 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:19.667084 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:19.677699 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:19.687148 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-499c96ac-2465-455d-984d-b19c18ffc2c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.224376 Nov 02 12:53:19.688081 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 74/130] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:19 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:19.814832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:19.823639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:19.825211 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:19.826335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-50a2dae0-4bbd-4809-bede-e42c0bc1c738 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.182043 Nov 02 12:53:19.826903 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 57/131] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:19 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:20.013349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:20.013950 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:20.020665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.021658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.022600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.023068 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.147454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:20.148154 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:20.156301 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.156818 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.157695 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.158356 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.175964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:20.183851 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ca82964a-6706-4a40-8efd-025bc473f24c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.174488 Nov 02 12:53:20.184452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 75/132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:20 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:20.377993 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:20.386254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f139b790-d758-4821-8b25-696f1c43a2a4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.243143 Nov 02 12:53:20.387042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 58/133] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:20 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:20.711596 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:20.712265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:20.719141 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.719596 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.720452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.721051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.857341 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:20.864457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:20.880492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.880964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.881744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:20.882197 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:20.962279 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:20.971740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-47a2f43c-fb17-46e5-9bd0-aad1f582a56a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.264480 Nov 02 12:53:20.984961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 76/134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:20 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:21.068154 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:21.079066 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:21.081773 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:21.084168 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c103e7f3-d5c9-4c8c-876c-bbdc1bf2f11a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.231141 Nov 02 12:53:21.084994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 59/135] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:20 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:21.207962 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:21.208727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:21.219270 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:21.222222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:21.225777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:21.226702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:21.414883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:21.415549 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:21.427139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:21.427970 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:21.429522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:21.430262 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:21.475182 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:21.483817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-44244bc5-721a-4513-8e36-d84a4221455e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.280567 Nov 02 12:53:21.498534 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 77/136] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:21 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:21.725939 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:21.738041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c7794764-f4e5-4f55-a673-fd64d3e9b81c tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.329098 Nov 02 12:53:21.738678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 60/137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:21 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:21.998609 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:21.999370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:22.009900 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.010467 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.012661 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.015789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.115789 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:22.116552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:22.124511 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.125632 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.126736 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.127262 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.201866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:22.209823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0d02cc28-58f7-4191-9cfa-dfcbc6a61c2a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.215454 Nov 02 12:53:22.210960 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 78/138] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:21 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:22.314331 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:22.322966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:22.324576 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:22.325713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-57694219-95eb-4fb0-b38d-ee2d385ad87c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.215195 Nov 02 12:53:22.326292 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 61/139] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:22 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:22.511627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:22.512636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:22.522279 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.523131 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.526349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.527940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.713523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:22.723608 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-401d5bfb-4739-4b6e-9d7f-438b79cd7500 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.220359 Nov 02 12:53:22.724687 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 79/140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:22 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:22.765151 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:22.767227 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:22.778990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.779859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.780922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:22.781775 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:22.958735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:22.967314 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-34cbf3d2-13f3-484c-92e1-f33eaefc97ba tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.207433 Nov 02 12:53:22.968711 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 62/141] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:22 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:23.234172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:23.234838 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:23.241229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:23.241672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:23.242618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:23.243046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:23.351137 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:23.352651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:23.360132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:23.360842 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:23.361826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:23.362454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:23.484051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.510506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4d6df5f8-d2f8-42bf-a379-9dd15b6ecdf6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.280392 Nov 02 12:53:23.513196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 80/142] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:23 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:23.566907 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.580263 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.582757 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.584170 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c104c159-4c1b-4b4a-b4ac-b69d2ddf8b46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.236849 Nov 02 12:53:23.585427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 63/143] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:23 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:23.748705 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:23.749579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:23.756500 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:23.757290 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:23.758311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:23.758831 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:23.925538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:23.932993 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fa4cdaa1-cb03-4e10-8016-556cf503f2b8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.189767 Nov 02 12:53:23.933805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 81/144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:23 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:23.992043 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:23.992717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:23.999339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:23.999806 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:24.000626 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:24.001224 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:24.189091 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:24.194600 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a5371769-cd96-43b0-9053-32173087bf7d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.207199 Nov 02 12:53:24.195541 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 64/145] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:23 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:24.537913 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:24.538531 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:24.553792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:24.554304 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:24.555311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:24.555764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:24.610472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:24.611082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:24.619384 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:24.621940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:24.625837 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:24.626479 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:24.737916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:24.747405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-675bc51e-58de-4801-b760-3cef76dd2dec tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.215419 Nov 02 12:53:24.748418 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 82/146] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:24 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:24.809033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:24.817502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:24.819185 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:24.820477 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b713526b-cb97-4de0-a94f-4543dd5d557d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.213997 Nov 02 12:53:24.821223 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 65/147] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:24 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:24.956760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:24.957363 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:24.967320 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:24.967778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:24.968579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:24.969014 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:25.219255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:25.220428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:25.231066 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:25.234830 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:25.236126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:25.237103 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:25.273694 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:25.290530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3cf86a86-ceec-4145-b031-2a137243e618 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.337844 Nov 02 12:53:25.305343 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 83/148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:24 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:25.519132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:25.533979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4fc22d3b-35f4-4196-aa22-85915bbe2e44 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.319826 Nov 02 12:53:25.534951 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 66/149] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:25 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:25.774964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:25.776316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:25.782963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:25.783629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:25.784443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:25.784880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:25.846064 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:25.846982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:25.853834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:25.854311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:25.855179 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:25.855633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:26.003258 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:26.013367 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:26.015990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:26.017390 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ca2e5223-f092-4045-b21a-65e5998c2870 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.175394 Nov 02 12:53:26.034880 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 67/150] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:25 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:26.038205 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:26.046266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7e5ed12d-76fc-4b16-bcfd-b64b72399be6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.275555 Nov 02 12:53:26.046858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 84/151] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:25 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:26.315353 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:26.315754 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:26.322334 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:26.322724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:26.323664 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:26.324049 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:26.494959 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:26.512268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2929670f-6c49-40b7-937a-d9dc852eb9a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.200951 Nov 02 12:53:26.513309 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 68/152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:26 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:26.559056 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:26.559731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:26.567343 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:26.567952 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:26.569011 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:26.569516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:26.763573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:26.770241 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-13ebeb52-0a27-4fb0-afa5-a2e3360c8b02 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.216185 Nov 02 12:53:26.771605 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 85/153] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:26 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:27.042589 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:27.043190 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:27.049155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.049612 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.050394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.050819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.069685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:27.070505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:27.077745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.078195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.078960 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.079402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.202122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:27.211938 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:27.214394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:27.216294 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9bca526a-4b95-4c19-8ebf-f74ff122b126 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.177299 Nov 02 12:53:27.217081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 69/154] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:27 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:27.222986 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:27.230827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d66ac9f9-44bf-498e-ad6e-5644c976eb8b tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.164861 Nov 02 12:53:27.231783 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 86/155] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:27 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:27.538060 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:27.538754 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:27.545269 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.545720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.546679 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.547117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.696368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:27.704545 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e986f79c-72f2-4500-ba7c-50dd4b92e162 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.170067 Nov 02 12:53:27.705101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 70/156] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:27 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:27.793352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:27.793964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:27.800413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.800867 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.801670 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:27.802106 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:27.897882 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-656294272", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "networks": [{"uuid": "dd913d2e-61bf-4776-8fa2-6366366409f4"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:27.957926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] validate_networks() for [('dd913d2e-61bf-4776-8fa2-6366366409f4', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:53:27.979407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:27.989498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6ecfa8d2-a703-401d-9f4a-52f6222053c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.199898 Nov 02 12:53:27.990293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 87/157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:27 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:28.267692 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-2a005c9f-92b1-42c8-81ce-523db46f1675 req-d5264d11-be77-425a-8a67-6f4e94f3410e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d458f0b-437a-41ff-93f3-1091857b39c8", "name": "network-vif-plugged", "status": "completed", "tag": "ceff5860-04fb-4226-b8ae-37c3cb9c96be"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:28.276814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-2a005c9f-92b1-42c8-81ce-523db46f1675 req-d5264d11-be77-425a-8a67-6f4e94f3410e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.277495 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-2a005c9f-92b1-42c8-81ce-523db46f1675 req-d5264d11-be77-425a-8a67-6f4e94f3410e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.296730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-2a005c9f-92b1-42c8-81ce-523db46f1675 req-d5264d11-be77-425a-8a67-6f4e94f3410e service nova] Creating event network-vif-plugged:ceff5860-04fb-4226-b8ae-37c3cb9c96be for instance 8d458f0b-437a-41ff-93f3-1091857b39c8 on hv-cinder-86327 Nov 02 12:53:28.304349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-2a005c9f-92b1-42c8-81ce-523db46f1675 req-d5264d11-be77-425a-8a67-6f4e94f3410e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108827 Nov 02 12:53:28.305960 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 88/158] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:53:28.314584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:28.315655 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:28.324283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.324967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.325817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.326255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.431715 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:53:28.432815 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:53:28.433302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:53:28.433704 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:53:28.434110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:53:28.461176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.461629 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.462483 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.462920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.502022 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Getting quotas for project 2c22011cb72447d49eaf0e623c2d423c. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:53:28.509409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Getting quotas for user f77ffa9a7dd44cf9b00c53d1356e0567 and project 2c22011cb72447d49eaf0e623c2d423c. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:53:28.525755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:28.548535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:53:28.548535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:53:28.553069 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:28.555185 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:28.556509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3e28e60b-31bf-4b42-8604-a4dec5d05552 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.246961 Nov 02 12:53:28.562520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 89/159] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:28 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:28.583309 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:28.583572 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:28.594938 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.596279 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.597335 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.600423 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.656240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-157a0859-6352-4167-8e3b-9c66cc6f7050 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762415 Nov 02 12:53:28.672412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 71/160] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:53:28.722722 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-407a8da5-eae8-4828-a1b4-53f24c71dc73 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:28.724979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-407a8da5-eae8-4828-a1b4-53f24c71dc73 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:28.840444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-407a8da5-eae8-4828-a1b4-53f24c71dc73 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:28.854059 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-407a8da5-eae8-4828-a1b4-53f24c71dc73 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1213 microversion: 2.1 time: 0.173338 Nov 02 12:53:28.854853 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 72/161] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:28 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:28.860187 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:28.861482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:28.868903 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.869363 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.870206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:28.871786 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:28.886453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:28.904671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-decb2069-cfcd-4c10-a2e0-e76646ef1cdf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.339123 Nov 02 12:53:28.906519 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 90/162] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:28 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:29.019830 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:29.020454 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:29.032294 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.032748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.033543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.033978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.227142 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.235010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.236395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a5931ab2-d023-4d12-9973-e1d424e6923b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.380427 Nov 02 12:53:29.237756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 73/163] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:28 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:29.251427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4ea9a2c8-22a2-4c17-a8b3-ae6a2e381417 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.240282 Nov 02 12:53:29.252138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 91/164] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:29 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:29.584180 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:29.584867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:29.592785 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.593224 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.593983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.594410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.738959 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.747589 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.749132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.750241 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-13c12b9a-b8cc-406c-9c23-20343cf0db83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.170846 Nov 02 12:53:29.751010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 74/165] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:29 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:29.881105 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:29.881685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:29.888832 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.888832 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.889581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.890008 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.931982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:29.932665 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:29.939053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.939493 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.940566 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:29.941080 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:29.956533 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.965260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8da9460d-754a-4a4f-a9ba-ed3e804af118 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1265 microversion: 2.1 time: 0.088115 Nov 02 12:53:29.965840 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 92/166] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:29 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:30.095141 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:30.105718 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5980cc92-f50e-4136-b07b-5b1235bcc6d2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.178614 Nov 02 12:53:30.106520 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 75/167] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:29 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:30.265868 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:30.266514 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:30.275252 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:30.275858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:30.279845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.280696 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.281035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.281464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.282721 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.283171 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.283943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.284414 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.427622 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:30.429722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:30.436707 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d239582f-06c2-4d45-aa7c-fe1ec70316d6 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.165985 Nov 02 12:53:30.437136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ca4e0392-de38-474f-906d-6bac3f8b5689 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.175796 Nov 02 12:53:30.437350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 76/168] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:30 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:30.444212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe9d261-592b-4b69-944d-5517465f6c40", "name": "network-vif-plugged", "status": "completed", "tag": "6f41fdae-476d-4c30-ba0a-43899e265ad5"}, {"server_uuid": "1839881d-97b0-4aa7-b398-2eeee344099f", "name": "network-vif-plugged", "status": "completed", "tag": "7a7f193c-8f61-4df5-8e3c-0d69f95daa2f"}, {"server_uuid": "980d235a-d1e0-4688-97c4-2e18bb50b977", "name": "network-vif-plugged", "status": "completed", "tag": "2059fb0f-4225-4fc2-af2b-4a514fca1328"}, {"server_uuid": "28d7f87e-6c63-40ee-9bf3-e454b81d34ee", "name": "network-vif-plugged", "status": "completed", "tag": "77048807-cd5e-48b1-8d83-bf09988266df"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:30.448697 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 93/169] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:30 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:30.462226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.462677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.488988 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Creating event network-vif-plugged:6f41fdae-476d-4c30-ba0a-43899e265ad5 for instance ebe9d261-592b-4b69-944d-5517465f6c40 on hv-cinder-86327 Nov 02 12:53:30.489488 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Creating event network-vif-plugged:7a7f193c-8f61-4df5-8e3c-0d69f95daa2f for instance 1839881d-97b0-4aa7-b398-2eeee344099f on hv-cinder-86327 Nov 02 12:53:30.489982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Creating event network-vif-plugged:2059fb0f-4225-4fc2-af2b-4a514fca1328 for instance 980d235a-d1e0-4688-97c4-2e18bb50b977 on hv-cinder-86327 Nov 02 12:53:30.490467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Creating event network-vif-plugged:77048807-cd5e-48b1-8d83-bf09988266df for instance 28d7f87e-6c63-40ee-9bf3-e454b81d34ee on hv-cinder-86327 Nov 02 12:53:30.491024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a3e463a3-b77d-4857-bb84-6fe3d1bc79c6 req-2a36327a-5c47-4a18-bf3c-cdaf2bdf56ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=124278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 02 12:53:30.492169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b7df279-9570-409c-8f54-57ec08c485ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.492598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b7df279-9570-409c-8f54-57ec08c485ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.493383 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b7df279-9570-409c-8f54-57ec08c485ba None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.494117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b7df279-9570-409c-8f54-57ec08c485ba None None] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.508841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.compute.rpcapi [None req-9b7df279-9570-409c-8f54-57ec08c485ba None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Nov 02 12:53:30.509878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b7df279-9570-409c-8f54-57ec08c485ba None None] Releasing lock "compute-rpcapi-router" {{(pid=124278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:53:30.533098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9b7df279-9570-409c-8f54-57ec08c485ba None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.093688 Nov 02 12:53:30.533629 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 77/170] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:30.782272 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:30.782272 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:30.787723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.788132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.789027 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:30.789368 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:30.992106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:30.993039 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:31.009603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.013917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.016976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.020889 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.029501 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.038498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.040162 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.041450 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-339553cc-9e4c-4791-9ba7-892324921868 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.268925 Nov 02 12:53:31.042484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 94/171] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:30 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:31.129368 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:31.129998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:31.137242 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.139701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.140657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.142197 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.143052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.145480 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-98bc7a8e-d86c-4db8-91ff-499d57372b3c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1283 microversion: 2.1 time: 0.158066 Nov 02 12:53:31.160244 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 78/172] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:30 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:31.350723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.358560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-745409f0-1df2-4311-a347-e024983c054f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.233268 Nov 02 12:53:31.359504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 95/173] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:31 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:31.463300 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:31.465098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:31.472604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:31.473399 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:31.481638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.482500 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.483548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.483811 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.484288 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.484487 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.485094 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:31.485637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:31.793410 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.806879 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bfaecc83-fa7f-40dd-81e6-74db667bd903 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1321 microversion: 2.1 time: 0.348475 Nov 02 12:53:31.807500 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 96/174] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:31 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:31.949564 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.959955 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3caf5c40-d7c5-4880-a89a-38a650ed9279 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.501620 Nov 02 12:53:31.974545 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 79/175] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:31 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:32.070575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.071856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:32.084239 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.084682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.085455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.085991 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.175217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.176150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:32.186853 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.187337 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.188143 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.188992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.293679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:32.310886 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:32.312406 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:32.318656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-86112ff0-871f-4974-9935-61f2845fd60b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.252822 Nov 02 12:53:32.332422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 97/176] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:32.383427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.384317 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:32.384521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:32.391738 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.392538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.392697 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6af133d8-cc88-467e-acc4-04f13281309f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.221371 Nov 02 12:53:32.393602 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.393816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 80/177] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:32.394377 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.609255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:32.617748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-22a9be60-5073-4797-a437-4302bcd5e61c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.238576 Nov 02 12:53:32.618529 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 98/178] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:32.832619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.833178 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:32.840115 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.840625 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.841372 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:32.841798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:32.990500 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.991292 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:32.998749 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.007620 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.007900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1dc23f36-b985-446c-b6ad-fc0338f36a1e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1515 microversion: 2.1 time: 0.179368 Nov 02 12:53:33.008301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.009198 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.009453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 81/179] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:33.009766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.035750 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:33.036798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:33.046082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.046720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.047644 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.048264 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.125966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lazy-loading 'flavor' on Instance uuid 8d458f0b-437a-41ff-93f3-1091857b39c8 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:53:33.280506 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a064e68c-a588-4a24-bb1e-e5b2c7b11872 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8/action" status: 200 len: 32 microversion: 2.1 time: 0.248717 Nov 02 12:53:33.286113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 82/180] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:53:33 2022] POST /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:53:33.292720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:33.293595 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:33.301128 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.301427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.302408 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.302873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.396502 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.405792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8a063554-ed7f-471f-85be-37f5c9737cd9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.420543 Nov 02 12:53:33.406380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 99/181] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:33.410993 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:33.411583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:33.418373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.418820 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.419764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.420352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.579994 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.589914 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.591999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.593388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bcb92c3c-f1c8-47f4-bda1-55a295f0f1b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.186083 Nov 02 12:53:33.594170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 100/182] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:33 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:33.598932 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:33.599472 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:33.614734 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.615202 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.615964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.616887 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.743446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.755609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-59f54cf9-24df-4a13-abfd-448a0df4f6bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.468052 Nov 02 12:53:33.760377 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 83/183] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:33 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:33.766394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:33.767339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:33.774913 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.775618 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.776908 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:33.777542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:33.803284 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.815022 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c57f4a23-a867-4c95-a849-e596d4fc8486 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.218655 Nov 02 12:53:33.816871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 101/184] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:33 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:34.047906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:34.055858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ffaec18b-08e7-4e4f-a655-6ac8de80ccd4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.293671 Nov 02 12:53:34.057492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 84/185] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:33 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:34.435233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:34.435949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:34.444082 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:34.445360 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:34.447667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:34.448716 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-869740b2-347f-47c8-af21-a70df1b00595 req-7fc6b54f-cfad-4bc3-9900-8e538224be47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fbcf05-b111-424e-b569-45dcf4e60494", "tag": "1ce312ed-47a3-4fe9-bde2-4ab8a334812b"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:34.449234 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:34.458203 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-869740b2-347f-47c8-af21-a70df1b00595 req-7fc6b54f-cfad-4bc3-9900-8e538224be47 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:34.461100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-869740b2-347f-47c8-af21-a70df1b00595 req-7fc6b54f-cfad-4bc3-9900-8e538224be47 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:34.492043 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-869740b2-347f-47c8-af21-a70df1b00595 req-7fc6b54f-cfad-4bc3-9900-8e538224be47 service nova] Creating event network-changed:1ce312ed-47a3-4fe9-bde2-4ab8a334812b for instance c8fbcf05-b111-424e-b569-45dcf4e60494 on hv-cinder-86327 Nov 02 12:53:34.498379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-869740b2-347f-47c8-af21-a70df1b00595 req-7fc6b54f-cfad-4bc3-9900-8e538224be47 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057464 Nov 02 12:53:34.501575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 85/186] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:34.620744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:34.623312 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:34.634352 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:34.634887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:34.635578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:34.638919 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:34.639069 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:34.648009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ce559a43-bcee-4f02-b63f-118b22f0d442 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.217434 Nov 02 12:53:34.649882 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 102/187] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:34 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:34.789050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:34.789896 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:34.797110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:34.798639 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:34.800562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:34.801326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:34.981708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:34.994207 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:34.996302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:35.001744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:35.012564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f8981d3a-e6a8-4c0c-b59d-cc721435a9fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.225395 Nov 02 12:53:35.020448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c2776667-d8c4-4615-b0e0-30a7bb0d31da tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.382350 Nov 02 12:53:35.020448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 86/188] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:34 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:35.021327 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 103/189] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:34 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:35.037460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:35.038134 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:35.044587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:35.045183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:35.045979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:35.046436 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:35.080112 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:35.080744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:35.087824 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:35.088309 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:35.089135 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:35.089563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:35.289230 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:35.298746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f2783525-cb92-48b2-a0df-b34cee0eb2ea tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1363 microversion: 2.1 time: 0.222476 Nov 02 12:53:35.312489 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 104/190] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:35 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:35.567297 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:35.576125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a84009ea-8347-43c8-8286-1189e3db211b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.557867 Nov 02 12:53:35.576906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 87/191] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:35 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:35.675478 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:35.676808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:35.683782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:35.684441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:35.685295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:35.685937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:35.906135 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:35.919130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-77f3e28f-7dc1-47f0-8ae9-276c09fa0a34 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1315 microversion: 2.1 time: 0.248067 Nov 02 12:53:35.931213 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 105/192] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:35 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:36.040108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:36.040894 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:36.065250 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.065703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.066776 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:36.067479 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:36.069691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.070132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.078348 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.078991 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.079885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.080404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.233906 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:36.241741 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:36.243326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:36.244527 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9a145bbe-412b-4195-ae2e-7e5c2eb65e1e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.191626 Nov 02 12:53:36.245098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 106/193] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:36 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:36.258158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:36.268382 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-305d7e91-5d95-4665-ad28-59782aead6a3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.232879 Nov 02 12:53:36.269203 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 88/194] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:36 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:36.322979 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:36.323615 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:36.329549 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.330000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.330766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.331200 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.469166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:36.477024 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-92959e6a-6fe1-4d5c-b5ef-61838bf59ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1548 microversion: 2.1 time: 0.157850 Nov 02 12:53:36.477592 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 107/195] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:36 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:36.502438 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-79fe4493-927f-41fd-ab43-c07bebe375ce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:36.503213 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-79fe4493-927f-41fd-ab43-c07bebe375ce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:36.510475 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79fe4493-927f-41fd-ab43-c07bebe375ce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.511049 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79fe4493-927f-41fd-ab43-c07bebe375ce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.511901 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79fe4493-927f-41fd-ab43-c07bebe375ce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.512363 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79fe4493-927f-41fd-ab43-c07bebe375ce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.594730 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-79fe4493-927f-41fd-ab43-c07bebe375ce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096389 Nov 02 12:53:36.595423 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 89/196] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 12:53:36 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:36.598844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:36.599445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:36.605891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.606331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.607066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.607651 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.943571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:36.945158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:36.951272 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.951791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:36.952704 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:36.953182 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:37.007870 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:37.016378 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4824d473-ea6a-4440-b5be-93bd0ad3c777 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.421268 Nov 02 12:53:37.017086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 108/197] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:36 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:37.143827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:37.152012 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-28dee776-da48-4bf0-a0f9-1ea224e77faf tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1503 microversion: 2.1 time: 0.212694 Nov 02 12:53:37.152985 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 90/198] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:36 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:37.272166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:37.273543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:37.280783 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:37.281241 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:37.286757 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:37.288451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:37.295933 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:37.296619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:37.311307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:37.312654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:37.315259 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:37.316444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:37.531417 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:37.546443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3d48aa1b-86b6-40dc-a20d-273e1e68b46c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.250644 Nov 02 12:53:37.547105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 91/199] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:37 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:37.830990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:37.839092 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:37.840599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:37.841729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-752638fe-3aeb-445b-b64e-517713514668 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1408 microversion: 2.20 time: 0.576111 Nov 02 12:53:37.842294 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 109/200] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:37 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1408 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:53:38.040128 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:38.040792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:38.051956 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:38.052433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:38.053208 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:38.053634 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:38.199493 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:38.210757 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7de37df5-3ca2-4f19-a6c4-c1ce2c20b58d tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.173769 Nov 02 12:53:38.212188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 92/201] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:38 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:38.436414 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-99938d61-26d0-4671-aa57-84be0bd3148a req-54d4bb38-3b3c-41f7-9c0e-96f792a696fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe9d261-592b-4b69-944d-5517465f6c40", "tag": "6f41fdae-476d-4c30-ba0a-43899e265ad5"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:38.444456 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-99938d61-26d0-4671-aa57-84be0bd3148a req-54d4bb38-3b3c-41f7-9c0e-96f792a696fb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:38.444957 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-99938d61-26d0-4671-aa57-84be0bd3148a req-54d4bb38-3b3c-41f7-9c0e-96f792a696fb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:38.456013 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-99938d61-26d0-4671-aa57-84be0bd3148a req-54d4bb38-3b3c-41f7-9c0e-96f792a696fb service nova] Creating event network-changed:6f41fdae-476d-4c30-ba0a-43899e265ad5 for instance ebe9d261-592b-4b69-944d-5517465f6c40 on hv-cinder-86327 Nov 02 12:53:38.461803 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-99938d61-26d0-4671-aa57-84be0bd3148a req-54d4bb38-3b3c-41f7-9c0e-96f792a696fb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086925 Nov 02 12:53:38.462353 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 110/202] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:38.573037 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:38.574210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:38.583123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:38.583890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:38.585058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:38.585633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:38.869795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:38.870974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:38.884083 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:38.887468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:38.888588 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:38.889143 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:38.923101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:38.955921 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1621ef59-5523-4c89-92bb-ca2227855f2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.382468 Nov 02 12:53:38.959057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 93/203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:38 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:39.068438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:39.078458 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:39.080245 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:39.081480 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5c0f8687-91b7-488a-8720-498a54f1831e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1600 microversion: 2.20 time: 0.218511 Nov 02 12:53:39.082112 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 111/204] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:53:38 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:53:39.107040 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a7692583-cfa8-4b0d-aabe-b84df1704078 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:39.107630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a7692583-cfa8-4b0d-aabe-b84df1704078 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:39.115083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7692583-cfa8-4b0d-aabe-b84df1704078 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.115525 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7692583-cfa8-4b0d-aabe-b84df1704078 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:39.116332 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7692583-cfa8-4b0d-aabe-b84df1704078 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.117082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7692583-cfa8-4b0d-aabe-b84df1704078 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:39.232323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a7692583-cfa8-4b0d-aabe-b84df1704078 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129493 Nov 02 12:53:39.238441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:39.239326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:39.240806 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 94/205] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Nov 2 12:53:39 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:53:39.246854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.247393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:39.248292 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.249000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:39.405664 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:39.413404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-101d018c-508e-4d33-bb9f-2969c3be410e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.178677 Nov 02 12:53:39.414072 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 112/206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:39 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:39.760573 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-eb868b6c-5573-47db-818a-5c5795cd3bc4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e2f4c76-8e69-49f0-83ec-1a976bb9ed83"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:39.762111 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-eb868b6c-5573-47db-818a-5c5795cd3bc4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:39.771378 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb868b6c-5573-47db-818a-5c5795cd3bc4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.772165 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb868b6c-5573-47db-818a-5c5795cd3bc4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:39.773570 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb868b6c-5573-47db-818a-5c5795cd3bc4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.774118 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb868b6c-5573-47db-818a-5c5795cd3bc4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:39.982599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:39.983366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:39.994354 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.995763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:39.996815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:39.997353 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:40.242262 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-eb868b6c-5573-47db-818a-5c5795cd3bc4 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "POST /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483576 Nov 02 12:53:40.246729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 95/207] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 12:53:39 2022] POST /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:40.306755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:40.316632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5370d42b-cf33-4c93-96f9-b5387d298dd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.337920 Nov 02 12:53:40.317656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 113/208] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:39 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:40.436957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:40.437940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:40.453098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:40.453872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:40.458660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:40.459478 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:40.757620 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:40.765700 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c892dff7-b373-4024-a87b-5f33ed98df07 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.333013 Nov 02 12:53:40.778685 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 96/209] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:40 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:40.930557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e76e4798-4590-4aa6-8a22-e906c2eeab27 req-8ee6da49-a121-4e9e-a100-5a159fa1fcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1839881d-97b0-4aa7-b398-2eeee344099f", "tag": "7a7f193c-8f61-4df5-8e3c-0d69f95daa2f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:40.939053 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e76e4798-4590-4aa6-8a22-e906c2eeab27 req-8ee6da49-a121-4e9e-a100-5a159fa1fcd9 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:40.939492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e76e4798-4590-4aa6-8a22-e906c2eeab27 req-8ee6da49-a121-4e9e-a100-5a159fa1fcd9 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:40.953119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e76e4798-4590-4aa6-8a22-e906c2eeab27 req-8ee6da49-a121-4e9e-a100-5a159fa1fcd9 service nova] Creating event network-changed:7a7f193c-8f61-4df5-8e3c-0d69f95daa2f for instance 1839881d-97b0-4aa7-b398-2eeee344099f on hv-cinder-86327 Nov 02 12:53:40.958143 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e76e4798-4590-4aa6-8a22-e906c2eeab27 req-8ee6da49-a121-4e9e-a100-5a159fa1fcd9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031479 Nov 02 12:53:40.958768 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 114/210] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:41.346933 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:41.347535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:41.354384 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:41.354825 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:41.355587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:41.356018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:41.489219 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:41.497094 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-93b1dc4f-4bc6-415b-82f9-6db952ec6bd9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.154036 Nov 02 12:53:41.497670 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 97/211] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:41 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:41.790767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:41.791805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:41.799355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:41.799947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:41.800885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:41.801408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:41.948785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:41.956300 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-89b46437-f764-49a9-8f4d-8791260a0a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.170126 Nov 02 12:53:41.956881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 115/212] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:41 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:42.522095 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:42.522600 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:42.529671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:42.530116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:42.530882 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:42.531309 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:42.685598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:42.693532 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2f5a6248-f636-4559-9a66-a5e4e3dc4f59 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.176096 Nov 02 12:53:42.694114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 98/213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:42 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:42.978983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:42.979588 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:42.985940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:42.986407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:42.987175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:42.987590 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:43.127617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:43.139784 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c4bc25f7-10f4-4b5f-a7d7-a943f70dffce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.164547 Nov 02 12:53:43.140621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 116/214] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:42 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:43.720133 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:43.721016 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:43.730661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:43.731200 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:43.732350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:43.732984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:43.875751 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:43.887215 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-44e56252-6edb-4cf7-b031-290e2fcc475a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.172622 Nov 02 12:53:43.888459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 99/215] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:43 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:44.169673 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:44.170269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:44.177323 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:44.177818 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:44.178643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:44.179092 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:44.314331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:44.322200 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d0d6b931-917d-4757-9d63-ee8c290f2d47 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.157923 Nov 02 12:53:44.323063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 117/216] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:44 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:44.918081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:44.918711 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:44.925357 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:44.925802 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:44.926559 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:44.926984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:45.075374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:45.082955 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c6044623-85ab-411a-98a0-e2d762c40e06 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.169183 Nov 02 12:53:45.083531 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 100/217] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:44 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:45.350234 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:45.351036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:45.361535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:45.362271 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:45.363511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:45.364256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:45.509995 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:45.517402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2db1887a-36dd-4713-ad3f-748ef0731b49 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.173896 Nov 02 12:53:45.517999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 118/218] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:45 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:46.109394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:46.110102 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:46.120342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:46.120657 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:46.121464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:46.121908 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:46.267357 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:46.275252 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3e3c43e9-eb8a-4049-a7a3-c73ef9fd36b3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.172100 Nov 02 12:53:46.275828 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 101/219] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:46 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:46.545096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:46.545731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:46.552289 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:46.552742 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:46.553513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:46.553955 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:46.713798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:46.722351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1852d399-740f-4f50-b221-fa4b44e7be36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.182183 Nov 02 12:53:46.722848 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 119/220] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:46 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:47.299558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:47.300165 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:47.306942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:47.307586 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:47.308386 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:47.308823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:47.457221 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:47.464997 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ecedc4e5-98be-4aaf-98bd-75b8886409fd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.169260 Nov 02 12:53:47.465595 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 102/221] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:47 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:47.748133 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:47.748875 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:47.758443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:47.759001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:47.760189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:47.760843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:47.911769 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:47.920178 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0303c6c0-0461-4a82-b000-8d87eb621143 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.177793 Nov 02 12:53:47.921667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 120/222] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:47 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:48.491533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:48.492413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:48.501702 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:48.502254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:48.503027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:48.503453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:48.658495 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:48.667635 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5fd2582c-58e7-4962-a297-f0887831a070 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.182099 Nov 02 12:53:48.668383 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 103/223] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:48 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:48.944045 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:48.944669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:48.951238 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:48.951730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:48.952518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:48.952977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:49.091686 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:49.099093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7b73f4c5-c750-4434-9c9a-14575ed6e4fd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.158970 Nov 02 12:53:49.099629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 121/224] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:48 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:49.691305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:49.691882 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:49.699856 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:49.700417 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:49.701518 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:49.702181 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:49.864655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:49.875522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3ae9b7d5-6326-40a2-90b7-b81e4229063a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.187963 Nov 02 12:53:49.876473 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 104/225] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:49 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:50.121935 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:50.122543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:50.128877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:50.129336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:50.130159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:50.130601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:50.268818 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:50.279051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ebca7a20-3231-4c0b-9d66-1ae359089392 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.161044 Nov 02 12:53:50.279623 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 122/226] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:50 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:50.911831 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:50.912802 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:50.921591 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:50.922053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:50.922872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:50.923299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:51.058097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:51.065990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-053ca961-8a89-4068-9c3c-62fe8659ce54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.160393 Nov 02 12:53:51.066571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 105/227] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:50 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:51.214312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-b36af49e-8804-4136-8001-15ea8c2565e7 req-95bb16bf-40ee-4d41-b191-6cc3c84da5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fbcf05-b111-424e-b569-45dcf4e60494", "name": "network-vif-plugged", "status": "completed", "tag": "1ce312ed-47a3-4fe9-bde2-4ab8a334812b"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:51.223305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-b36af49e-8804-4136-8001-15ea8c2565e7 req-95bb16bf-40ee-4d41-b191-6cc3c84da5a2 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:51.223788 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-b36af49e-8804-4136-8001-15ea8c2565e7 req-95bb16bf-40ee-4d41-b191-6cc3c84da5a2 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:51.237223 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-b36af49e-8804-4136-8001-15ea8c2565e7 req-95bb16bf-40ee-4d41-b191-6cc3c84da5a2 service nova] Creating event network-vif-plugged:1ce312ed-47a3-4fe9-bde2-4ab8a334812b for instance c8fbcf05-b111-424e-b569-45dcf4e60494 on hv-cinder-86327 Nov 02 12:53:51.242299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-b36af49e-8804-4136-8001-15ea8c2565e7 req-95bb16bf-40ee-4d41-b191-6cc3c84da5a2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031781 Nov 02 12:53:51.243086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 123/228] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:51.302807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:51.303438 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:51.309639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:51.310076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:51.310828 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:51.311254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:51.471854 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:51.479619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2df6489a-6b75-465e-9afb-4a580f802536 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.180875 Nov 02 12:53:51.480193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 106/229] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:51 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:52.090190 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:52.090954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:52.097535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:52.098099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:52.099328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:52.099864 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:52.291874 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:52.299527 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-00830cf4-37ed-4d76-96ad-db764f95d39c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.213905 Nov 02 12:53:52.300349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 124/230] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:52 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:52.504759 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:52.505307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:52.519913 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:52.520963 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:52.521907 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:52.522345 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:52.666752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:52.675156 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e1544bb4-e36e-45cb-96b2-948883941426 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.175921 Nov 02 12:53:52.675767 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 107/231] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:52 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:53.323082 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:53.323687 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:53.330587 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:53.331032 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:53.332172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:53.332780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:53.487183 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:53.498185 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-60be46f3-ce19-4e5a-ac1c-a6d9eb6227ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.178911 Nov 02 12:53:53.498897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 125/232] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:53 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:53.699100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:53.700400 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:53.706923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:53.707405 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:53.708163 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:53.708616 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:53.861552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:53.870052 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-532dc743-637b-46e1-946f-8be7639216eb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1313 microversion: 2.1 time: 0.174915 Nov 02 12:53:53.871452 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 108/233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:53 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:54.524650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:54.525409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:54.531881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:54.532536 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:54.533295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:54.533880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:54.734483 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:54.743103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-84d106ba-30a5-4a3f-b2a0-7b954c970d60 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.223984 Nov 02 12:53:54.752726 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 126/234] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:54 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:54.894010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:54.895284 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:54.903321 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:54.903972 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:54.904776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:54.905354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:55.148195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:55.156733 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-743a79ee-6846-4443-9135-cc5420cfcdb2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1497 microversion: 2.1 time: 0.266810 Nov 02 12:53:55.157734 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 109/235] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:54 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1497 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:55.767713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:55.768889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:55.776591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:55.777269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:55.778547 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:55.779262 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:55.937359 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:55.946584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b132a4c3-3ee3-4689-a285-e358eccca85c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.183423 Nov 02 12:53:55.947169 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 127/236] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:55 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:56.143526 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:56.144077 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:56.151340 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.151797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.152653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.153410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.178161 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 12:53:56.271227 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-69324f6e-93f0-4f5d-95c8-05d63e08dd7c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 204 len: 0 microversion: 2.1 time: 0.131835 Nov 02 12:53:56.272245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 110/237] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 12:53:56 2022] DELETE /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:56.281249 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:56.282037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:56.288798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.289349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.290581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.291224 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.430115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:56.438163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ae405ce6-f52d-47b7-909e-16a96e36b42b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1503 microversion: 2.1 time: 0.161279 Nov 02 12:53:56.438726 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 128/238] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:56 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:56.700063 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:56.700772 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:56.707182 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.707641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.708443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.708885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.733418 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 12:53:56.819666 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-109b4a7f-be98-4486-84d9-3e7716007094 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "DELETE /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 204 len: 0 microversion: 2.1 time: 0.123870 Nov 02 12:53:56.820787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 111/239] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 12:53:56 2022] DELETE /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:56.829306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:56.829947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:56.836195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.836676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.837443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.837877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.971648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:56.972376 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:56.977462 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:56.979083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.979531 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.980338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:56.980966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:56.985776 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8bffb911-5449-499b-96c8-3a2b9a51b861 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.160454 Nov 02 12:53:56.986288 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 129/240] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:56 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:57.142609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:57.151025 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7de12f27-fc51-4b62-8d40-078d60d89d1f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.183769 Nov 02 12:53:57.151601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 112/241] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:56 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:57.466569 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:57.467530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:57.477957 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:57.478641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:57.479802 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:57.480496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:57.617582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:57.625860 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e676ea3f-4bff-4029-ac65-17ca5c3a7c86 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1503 microversion: 2.1 time: 0.165727 Nov 02 12:53:57.626408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 130/242] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:57 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:58.009646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:58.010570 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:58.017130 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.017583 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.018340 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.018782 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.160504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:58.170922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4d5c2f0b-178f-4789-b277-1fdd7d4cc290 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.165299 Nov 02 12:53:58.171760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 113/243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:58 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:58.175769 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:58.176409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:58.183413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.183874 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.184693 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.185134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.325581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:58.333165 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-db1a36d5-fc7a-4b7e-8960-8bd33ff704d0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.162246 Nov 02 12:53:58.339696 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 131/244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:58 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:58.363257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-828417020", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "networks": [{"uuid": "329375eb-0ff0-44d5-899a-7723bd92ed6a"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:58.417039 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] validate_networks() for [('329375eb-0ff0-44d5-899a-7723bd92ed6a', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:53:58.654409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:58.655111 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:58.661635 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.662153 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.662983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.663680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.768581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:53:58.769081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:53:58.769582 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:53:58.770017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:53:58.770770 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:53:58.779946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.780476 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.781320 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:58.781814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:58.798358 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Getting quotas for project 90b42fe203384f8c852afe1c917d4f40. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:53:58.801982 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:58.802477 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Getting quotas for user a05c9a5fa170471aa8d73e243ffc30b8 and project 90b42fe203384f8c852afe1c917d4f40. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:53:58.810370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-82d02f44-24e3-4812-9553-98d4c4d5feb1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1503 microversion: 2.1 time: 0.159927 Nov 02 12:53:58.811250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 132/245] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:58 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:58.814252 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:53:58.816661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:53:58.865973 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c46ec1d5-8990-4480-bbe2-0ee345536e50 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506603 Nov 02 12:53:58.866769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 114/246] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:53:58.878361 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-630a6663-5272-447a-9c81-049471aa3695 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:58.879052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-630a6663-5272-447a-9c81-049471aa3695 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:58.935147 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-630a6663-5272-447a-9c81-049471aa3695 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:58.942666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-630a6663-5272-447a-9c81-049471aa3695 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1218 microversion: 2.1 time: 0.068126 Nov 02 12:53:58.943250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 133/247] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:58 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:59.195536 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:59.196138 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:59.205254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.205814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.206457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.206889 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.350415 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:59.361543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:59.362900 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:59.365987 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3796c4cb-16ec-4bc4-a6d4-ab07972d9817 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.175010 Nov 02 12:53:59.366840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 115/248] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:59 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:59.379486 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.380429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.381541 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.382868 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.518654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:59.528819 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-65802d37-934b-4aff-87df-6fcbe2a40af8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.175828 Nov 02 12:53:59.529644 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 134/249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:59 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:59.840821 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:59.841457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:59.848147 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.848650 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.849567 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.850217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.966441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:59.967336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:53:59.973631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.974190 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.975252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:53:59.975657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:53:59.995807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:00.003790 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-23a6c724-8d03-435f-84d6-7ff9cc116fd7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1503 microversion: 2.1 time: 0.171744 Nov 02 12:54:00.004391 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 116/250] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:59 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:00.051722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:00.059306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3c262892-8009-461f-9865-e4cd7bcc5c16 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1270 microversion: 2.1 time: 0.097368 Nov 02 12:54:00.060003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 135/251] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:59 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:00.390289 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:00.390869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:00.397878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:00.398266 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:00.399020 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:00.400129 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:00.553475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:00.554303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:00.561120 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:00.561595 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:00.562439 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:00.563002 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:00.570773 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:00.579280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-202ac595-4014-4d3f-9659-dd0b66896d61 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.193214 Nov 02 12:54:00.579957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 117/252] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:00 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:00.716042 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:00.723786 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7ab2281e-e36c-41f9-a550-aeac21f63baa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.175001 Nov 02 12:54:00.724488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 136/253] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:00 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:01.028187 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:01.029031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:01.035900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.036445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.037307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.037841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.083156 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:01.084445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:01.090883 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.091389 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.092401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.092916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.161211 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:01.172330 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-06932490-49e9-4f39-a7df-40aea2c0f074 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1270 microversion: 2.1 time: 0.090206 Nov 02 12:54:01.173372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 137/254] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:01 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:01.415462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:01.423846 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bd50e573-87c3-4e7a-96c2-5f29d9f91420 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1503 microversion: 2.1 time: 0.400105 Nov 02 12:54:01.424460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 118/255] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:01 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:01.604090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:01.604778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:01.611181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.611627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.612441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.612874 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.735431 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d50b5f35-9dd7-47de-b0e9-c5b2c7a4fddd req-8d8cdda5-a542-44c1-b3fa-835cd441ff91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fbcf05-b111-424e-b569-45dcf4e60494", "name": "network-vif-deleted", "tag": "1ce312ed-47a3-4fe9-bde2-4ab8a334812b"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:01.743899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d50b5f35-9dd7-47de-b0e9-c5b2c7a4fddd req-8d8cdda5-a542-44c1-b3fa-835cd441ff91 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.744381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d50b5f35-9dd7-47de-b0e9-c5b2c7a4fddd req-8d8cdda5-a542-44c1-b3fa-835cd441ff91 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.751159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:01.755866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d50b5f35-9dd7-47de-b0e9-c5b2c7a4fddd req-8d8cdda5-a542-44c1-b3fa-835cd441ff91 service nova] Creating event network-vif-deleted:1ce312ed-47a3-4fe9-bde2-4ab8a334812b for instance c8fbcf05-b111-424e-b569-45dcf4e60494 on hv-cinder-86327 Nov 02 12:54:01.759638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0180375e-9681-49f3-83a8-0f4eb7b820e2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.159812 Nov 02 12:54:01.760236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 138/256] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:01 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:01.763062 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d50b5f35-9dd7-47de-b0e9-c5b2c7a4fddd req-8d8cdda5-a542-44c1-b3fa-835cd441ff91 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031285 Nov 02 12:54:01.763817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 119/257] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:54:01.764874 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:01.765472 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:01.772331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.772800 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.773550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:01.773981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:01.913326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:01.922858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-48ff116a-124b-49be-9746-7968e3d75e5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.161441 Nov 02 12:54:01.923527 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 139/258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:01 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:02.200895 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:02.201661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:02.208561 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.209011 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:02.209800 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.210223 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:02.278865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:02.286527 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-57dbcea9-7af6-4a8f-9d54-59489c8e8634 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1270 microversion: 2.1 time: 0.092871 Nov 02 12:54:02.287093 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 120/259] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:02 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:02.448593 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:02.449198 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:02.455966 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.456378 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:02.457142 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.457583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:02.518464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:02.526594 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9c40ff8d-9ad4-4ac4-97d5-f49aa678df7b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1461 microversion: 2.1 time: 0.082159 Nov 02 12:54:02.527164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 140/260] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:02 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:02.784603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:02.785225 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:02.793802 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.794327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:02.795280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.795793 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:02.939190 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:02.947809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a02805bd-07e4-41e3-aba6-a9c04de1a666 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.167999 Nov 02 12:54:02.948445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 121/261] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:02 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:02.954136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:02.954591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:02.961252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.961694 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:02.962468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:02.962891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:03.096921 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:03.108247 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0d12633d-5c8b-415d-af3e-7f080a1503d1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.158098 Nov 02 12:54:03.109012 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 141/262] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:02 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:03.314636 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:03.315260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:03.321363 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:03.321819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:03.322612 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:03.323050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:03.385183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:03.394551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bf0bf31a-3a66-4c93-ba3d-04ee7d1f6b48 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1270 microversion: 2.1 time: 0.084359 Nov 02 12:54:03.395155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 122/263] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:03 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:03.551590 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:03.552233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:03.559082 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:03.559453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:03.560228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:03.560740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:03.634698 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:03.642933 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1d495a02-470c-40fa-9708-bb61684a144a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1461 microversion: 2.1 time: 0.095378 Nov 02 12:54:03.643539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 142/264] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:03 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1461 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:03.972603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:03.973218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:03.979987 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:03.980467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:03.981258 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:03.981688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:04.129929 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:04.138143 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b7a7291f-07ce-49bc-96d5-9ce15c8213de tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.169408 Nov 02 12:54:04.138431 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:04.138899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 123/265] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:03 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:04.139046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:04.145153 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:04.145965 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:04.146737 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:04.147176 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:04.283785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:04.293159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-60f4569e-6442-47ef-86fc-87e2b48c1d2e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.158469 Nov 02 12:54:04.293755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 143/266] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:04 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:04.421441 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:04.422080 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:04.428343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:04.428814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:04.429592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:04.430031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:04.492672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:04.502942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-38677436-0976-4846-b123-bf9197ecf1bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1270 microversion: 2.1 time: 0.087874 Nov 02 12:54:04.503520 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 124/267] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:04 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:04.671344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:04.672366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:04.683010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:04.683758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:04.685080 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:04.685802 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:04.746420 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:04.754335 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-165b98fa-8df2-4b8e-8080-218976014381 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1461 microversion: 2.1 time: 0.089684 Nov 02 12:54:04.754900 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 144/268] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:04 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:05.166557 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:05.167498 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:05.175741 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.176195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.177016 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.177447 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.321797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:05.326266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:05.326868 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:05.333022 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.333311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a9257da5-d30f-45f2-98e6-ed1bb5dfad98 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.173470 Nov 02 12:54:05.333516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.343006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.343006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.343429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 125/269] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:05 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:05.475574 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:05.483328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-173c7613-6fa3-4fe7-8343-1e2430b6f8f0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.160835 Nov 02 12:54:05.483913 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 145/270] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:05 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:05.526869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:05.527533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:05.533821 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.534299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.535066 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.535505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.602220 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:05.610150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c63641d9-1afd-4a0a-affd-450180797db8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1278 microversion: 2.1 time: 0.088083 Nov 02 12:54:05.610733 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 126/271] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:05 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:05.778786 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:05.779312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:05.785778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.786228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.787043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.787477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.820948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:05.821452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:05.821936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lazy-loading 'fault' on Instance uuid c8fbcf05-b111-424e-b569-45dcf4e60494 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:05.868889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:05.876805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c79e7a75-4976-4fa9-8553-a1c2521b3cac tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1303 microversion: 2.1 time: 0.102345 Nov 02 12:54:05.877385 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 146/272] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:05 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:06.357563 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:06.359092 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:06.365763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.366342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.367171 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.367672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.511844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:06.513681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:06.520972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.521633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.522895 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.523512 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.652947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:06.679792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e8ea3b03-410b-45de-b1f8-3463de8153a0 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.325880 Nov 02 12:54:06.680430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 127/273] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:06 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:06.681339 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:06.688025 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:06.688686 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:06.690280 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-75d5fd07-51f2-4322-94e9-64b09ac17304 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.186309 Nov 02 12:54:06.691031 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 147/274] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:06 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:06.704330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.704330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.704330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.704330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.894572 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:06.902845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:06.903002 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b3060cc2-a65e-4b3b-bbf7-5ac7a0684aab tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.220071 Nov 02 12:54:06.903670 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:06.903786 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 128/275] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:06 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:06.912422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.912845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.913794 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.914421 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.945403 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:06.945846 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:06.946287 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lazy-loading 'fault' on Instance uuid c8fbcf05-b111-424e-b569-45dcf4e60494 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:06.991008 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:06.998478 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bab9d537-51ae-43f5-9eeb-6add61d81a36 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1303 microversion: 2.1 time: 0.099471 Nov 02 12:54:06.999195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 148/276] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:06 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:07.348798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-692edd8d-67df-4acc-9ffe-bdc537f28349 req-1f7bac00-9de2-4623-ba43-6a006a43ed5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f561ba4f-0814-475b-8ad1-5e79cfe5b851", "tag": "f9228980-d82d-4aaa-a38d-0af21963a57f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:07.357112 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-692edd8d-67df-4acc-9ffe-bdc537f28349 req-1f7bac00-9de2-4623-ba43-6a006a43ed5f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:07.357552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-692edd8d-67df-4acc-9ffe-bdc537f28349 req-1f7bac00-9de2-4623-ba43-6a006a43ed5f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:07.369922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-692edd8d-67df-4acc-9ffe-bdc537f28349 req-1f7bac00-9de2-4623-ba43-6a006a43ed5f service nova] Creating event network-changed:f9228980-d82d-4aaa-a38d-0af21963a57f for instance f561ba4f-0814-475b-8ad1-5e79cfe5b851 on hv-cinder-86327 Nov 02 12:54:07.375040 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-692edd8d-67df-4acc-9ffe-bdc537f28349 req-1f7bac00-9de2-4623-ba43-6a006a43ed5f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030336 Nov 02 12:54:07.375768 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 129/277] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:07.708405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:07.709327 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:07.719144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:07.719599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:07.719950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:07.720146 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:07.721015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:07.721440 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:07.726490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:07.726935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:07.727706 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:07.728144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:07.858965 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:07.861724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:07.866999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2753f8a1-33e1-4fbf-ba7f-ab0791f62c79 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.165268 Nov 02 12:54:07.867609 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 149/278] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:07 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:07.870031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-41cd73c9-0a4a-4d69-9da4-7295b516eaea tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.158001 Nov 02 12:54:07.870669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 130/279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:07 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:07.926603 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:07.927224 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:07.933457 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:07.933971 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:07.934817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:07.935317 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:08.022902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:08.023712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:08.029890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:08.030311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:08.031121 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:08.031591 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:08.062059 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:08.062540 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:08.063193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lazy-loading 'fault' on Instance uuid c8fbcf05-b111-424e-b569-45dcf4e60494 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:08.079877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:08.087458 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1d088651-4d70-437b-b711-9d3fe5b5ae54 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.164770 Nov 02 12:54:08.088075 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 150/280] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:07 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:08.106283 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:08.114263 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-333ee5ad-4778-415b-a11c-09577bd891dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1303 microversion: 2.1 time: 0.096153 Nov 02 12:54:08.114839 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 131/281] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:08 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:08.891125 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:08.891701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:08.893556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:08.894167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:08.898805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:08.899263 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:08.900016 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:08.900470 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:08.901290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:08.901747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:08.902514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:08.902949 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:09.042049 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:09.048108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:09.050454 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6c5e8407-faac-4d17-a5df-85282ee6c683 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.163496 Nov 02 12:54:09.051030 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 151/282] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:08 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:09.055732 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9e90f3ba-36f3-48dc-9029-185a5ad96864 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.166094 Nov 02 12:54:09.056335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 132/283] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:08 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:09.110613 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:09.111216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:09.117917 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:09.118369 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:09.119136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:09.119568 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:09.138423 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:09.139044 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:09.145182 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:09.145930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:09.146693 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:09.147130 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:09.179529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:09.179975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:09.180444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lazy-loading 'fault' on Instance uuid c8fbcf05-b111-424e-b569-45dcf4e60494 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:09.220674 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:09.228473 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-abb335bf-e0e9-44a8-84f6-824694babc84 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1303 microversion: 2.1 time: 0.093992 Nov 02 12:54:09.229024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 133/284] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:09 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:09.254880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:09.262596 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-045c5c9f-c6de-494f-9cd6-bb54ad9912b6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.155930 Nov 02 12:54:09.263179 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 152/285] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:09 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:10.077297 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:10.077896 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:10.080457 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:10.081065 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:10.084835 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.085290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.086060 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.086494 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.087154 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.087629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.088420 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.088852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.223186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:10.228517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:10.232018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bd59e79c-c18f-4eae-9428-2a7d38f01635 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.162019 Nov 02 12:54:10.232676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 134/286] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:10 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:10.236117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aee7ee67-8e55-4860-9cd0-07d9a6ec7033 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.159601 Nov 02 12:54:10.236923 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 153/287] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:10 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:10.251140 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:10.251745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:10.257978 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.258361 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.259114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.259546 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.286083 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:10.286732 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:10.290226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.290671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.291107 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lazy-loading 'fault' on Instance uuid c8fbcf05-b111-424e-b569-45dcf4e60494 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:10.292682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.293136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.293892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:10.294343 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:10.336054 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:10.344470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1d11c912-aa3c-45f9-bf51-92bcb01032ed tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1303 microversion: 2.1 time: 0.097125 Nov 02 12:54:10.345030 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 135/288] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:10 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:10.433301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:10.441979 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d9898343-c87c-457b-bdab-e968bb8b631a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.160011 Nov 02 12:54:10.442586 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 154/289] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:10 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:11.255406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:11.255996 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:11.258901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:11.259511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:11.264620 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.265077 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.265822 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.265951 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.266287 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.266401 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.267067 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.267495 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.406813 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:11.412051 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:11.415003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-21163a77-490d-43e8-90a3-c13468231f32 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.159961 Nov 02 12:54:11.415859 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 155/290] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:11 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:11.420237 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:11.420729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-62ad0ae4-b6a0-46ad-9aab-3b4bc72886c9 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.169193 Nov 02 12:54:11.420832 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:11.421548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 136/291] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:11 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:11.426852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.427307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.428240 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.428692 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.461277 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.461753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.462151 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lazy-loading 'fault' on Instance uuid c8fbcf05-b111-424e-b569-45dcf4e60494 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:11.465421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:11.466041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:11.472153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.472776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.473551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.473979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.505957 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:11.514386 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-373da711-d7ac-4cb4-b69e-8f672afb91f2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 200 len: 1303 microversion: 2.1 time: 0.097672 Nov 02 12:54:11.515430 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 156/292] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:11 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:11.610114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:11.618571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-72f885ef-0785-4dd1-8fd0-660dfbd1ea45 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.157043 Nov 02 12:54:11.619166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 137/293] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:11 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:11.931812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-143f428f-72ff-4cdc-8349-9ad8f2701851 req-bcb44014-0eb9-4b59-bd4f-f4cc32041511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "980d235a-d1e0-4688-97c4-2e18bb50b977", "name": "network-vif-unplugged", "status": "completed", "tag": "2059fb0f-4225-4fc2-af2b-4a514fca1328"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:11.941088 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-143f428f-72ff-4cdc-8349-9ad8f2701851 req-bcb44014-0eb9-4b59-bd4f-f4cc32041511 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:11.941615 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-143f428f-72ff-4cdc-8349-9ad8f2701851 req-bcb44014-0eb9-4b59-bd4f-f4cc32041511 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:11.953565 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-143f428f-72ff-4cdc-8349-9ad8f2701851 req-bcb44014-0eb9-4b59-bd4f-f4cc32041511 service nova] Creating event network-vif-unplugged:2059fb0f-4225-4fc2-af2b-4a514fca1328 for instance 980d235a-d1e0-4688-97c4-2e18bb50b977 on hv-cinder-86327 Nov 02 12:54:11.958947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-143f428f-72ff-4cdc-8349-9ad8f2701851 req-bcb44014-0eb9-4b59-bd4f-f4cc32041511 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031083 Nov 02 12:54:11.959746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 157/294] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:12.444615 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:12.445325 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:12.448854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:12.449737 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:12.453634 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.454166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.455172 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.455574 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.457211 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.457656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.458427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.458856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.591862 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:12.593324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:12.599472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-59105fce-64bb-49ea-acb7-987e438f70f7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.159910 Nov 02 12:54:12.600176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 138/295] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:12 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:12.601381 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c4e2a8fb-02e4-4e99-96c5-00ecfb994459 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.157463 Nov 02 12:54:12.608276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 158/296] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:12 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:12.608410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:12.608410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: c8fbcf05-b111-424e-b569-45dcf4e60494] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:12.612354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.612354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.613031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.613465 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.627217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] HTTP exception thrown: Instance c8fbcf05-b111-424e-b569-45dcf4e60494 could not be found. Nov 02 12:54:12.627841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Returning 404 to user: Instance c8fbcf05-b111-424e-b569-45dcf4e60494 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:54:12.628724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-28bafb54-43ff-4c8d-a5d7-9bbf6f2297e2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494" status: 404 len: 111 microversion: 2.1 time: 0.027430 Nov 02 12:54:12.629467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 139/297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:12 2022] GET /compute/v2.1/servers/c8fbcf05-b111-424e-b569-45dcf4e60494 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:12.647753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:12.648600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:12.654999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.655449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.656256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:12.656700 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:12.730780 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1136746535", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "networks": [{"uuid": "dd913d2e-61bf-4776-8fa2-6366366409f4"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:12.782575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] validate_networks() for [('dd913d2e-61bf-4776-8fa2-6366366409f4', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:54:12.792482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:12.800079 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-101ab275-d080-49c4-8520-f280cd2c186e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.156612 Nov 02 12:54:12.800725 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 159/298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:12 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:13.623465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:13.624244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:13.630630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.631172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:13.632146 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.632604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:13.646314 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:54:13.646738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:54:13.647168 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:54:13.647763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:54:13.648179 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:54:13.664880 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.665322 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:13.666125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.666554 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:13.697575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Getting quotas for project 2c22011cb72447d49eaf0e623c2d423c. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:54:13.701950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Getting quotas for user f77ffa9a7dd44cf9b00c53d1356e0567 and project 2c22011cb72447d49eaf0e623c2d423c. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:54:13.714309 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:54:13.717046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:54:13.770701 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1da8dd05-fd47-4a3e-a06b-4c5812793a66 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043461 Nov 02 12:54:13.771788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 140/299] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:54:13.777176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:13.778214 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:13.786831 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.787399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:13.788636 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.789161 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:13.844287 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:13.853539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9fef7052-db17-4db8-b3b3-a0abb56a17d9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.233893 Nov 02 12:54:13.855466 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 160/300] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:13 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:13.861925 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-942a02b6-c93e-489a-9104-377555a33da1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:13.862883 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-942a02b6-c93e-489a-9104-377555a33da1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:13.924260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-942a02b6-c93e-489a-9104-377555a33da1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:13.931599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-942a02b6-c93e-489a-9104-377555a33da1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1214 microversion: 2.1 time: 0.074831 Nov 02 12:54:13.932307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 161/301] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:13 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:13.937224 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:13.938081 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:13.944603 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.945331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:13.947156 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:13.947646 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:14.095863 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:14.104795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5b226ed5-75ed-4396-9035-7a2b15bd32e6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.171335 Nov 02 12:54:14.105453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 162/302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:13 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:14.290239 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:14.304098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e685be41-c3cb-45eb-a854-5f338d1db4c2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1555 microversion: 2.1 time: 0.530822 Nov 02 12:54:14.305065 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 141/303] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:13 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1555 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:14.695562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-759ce9ee-c652-4e16-9297-2dc31ffac78d req-006d81c1-6ed7-4f81-8f85-09f9afc25a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "980d235a-d1e0-4688-97c4-2e18bb50b977", "name": "network-vif-deleted", "tag": "2059fb0f-4225-4fc2-af2b-4a514fca1328"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:14.709008 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-759ce9ee-c652-4e16-9297-2dc31ffac78d req-006d81c1-6ed7-4f81-8f85-09f9afc25a78 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:14.709451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-759ce9ee-c652-4e16-9297-2dc31ffac78d req-006d81c1-6ed7-4f81-8f85-09f9afc25a78 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:14.724325 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-759ce9ee-c652-4e16-9297-2dc31ffac78d req-006d81c1-6ed7-4f81-8f85-09f9afc25a78 service nova] Creating event network-vif-deleted:2059fb0f-4225-4fc2-af2b-4a514fca1328 for instance 980d235a-d1e0-4688-97c4-2e18bb50b977 on hv-cinder-86327 Nov 02 12:54:14.730267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-759ce9ee-c652-4e16-9297-2dc31ffac78d req-006d81c1-6ed7-4f81-8f85-09f9afc25a78 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039209 Nov 02 12:54:14.731443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 163/304] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:14.880897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:14.881455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:14.888600 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:14.889058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:14.889833 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:14.890273 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:14.955457 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:14.956465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:14.963324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:14.963744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:14.964780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:14.965284 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:15.043867 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:15.053164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2203da95-4783-45a8-8264-04338fd16c90 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1266 microversion: 2.1 time: 0.102058 Nov 02 12:54:15.053768 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 164/305] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:14 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:15.062639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:15.071506 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b2167d01-f4ee-46b8-a6a6-35aa87c108a7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.195146 Nov 02 12:54:15.072105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 142/306] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:14 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:15.130071 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:15.130679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:15.137099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:15.137677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:15.138675 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:15.139286 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:15.284754 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:15.292907 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9beadd0e-7c6d-41ea-8791-0984ead5aa86 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.167041 Nov 02 12:54:15.293504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 165/307] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:15 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:15.330870 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:15.331497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:15.338036 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:15.338488 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:15.339279 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:15.339712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:15.406783 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:15.415658 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-48506002-9123-46a1-9148-8a2307a1dd63 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.090790 Nov 02 12:54:15.416254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 143/308] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:15 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:16.081217 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:16.081871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:16.089685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.090318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.091223 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.091722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.096167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:16.097058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:16.105370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.105936 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.106830 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.107523 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.154998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:16.162565 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7f260ed0-2e74-46d7-8469-f8d895d54450 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1266 microversion: 2.1 time: 0.087835 Nov 02 12:54:16.163406 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 166/309] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:16 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:16.244231 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:16.251904 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-04064536-cd55-46af-ad46-4799bd8ebd7d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.160341 Nov 02 12:54:16.252532 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 144/310] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:16 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:16.318939 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:16.320031 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:16.329113 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.329742 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.330701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.331125 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.440718 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:16.441360 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:16.447858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.448328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.449108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:16.449544 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:16.472273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:16.479804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-12142bc5-10b9-4406-aa01-4ffd19bca3cd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.166334 Nov 02 12:54:16.480367 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 167/311] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:16 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:16.514488 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:16.523760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-80380916-d896-497b-8c58-7a5273e89b87 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.087030 Nov 02 12:54:16.524357 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 145/312] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:16 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:17.190220 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:17.190830 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:17.197305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.197755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.198554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.198992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.258140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:17.266066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c57acf77-99e8-4923-be49-cc06e41283cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1266 microversion: 2.1 time: 0.082704 Nov 02 12:54:17.266636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 168/313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:17 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:17.275659 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:17.276322 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:17.283142 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.283596 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.284445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.284878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.421333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:17.432850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d72679d7-7d69-4c87-b7b4-0d70d2df963b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.160921 Nov 02 12:54:17.433602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 146/314] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:17 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:17.508261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:17.509406 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:17.519576 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.520036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.521225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.521680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.547023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:17.547624 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:17.554514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.554957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.555717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:17.556140 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:17.618547 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:17.626510 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e08a7296-e8c8-4eb7-8ce6-d17921813d75 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.083506 Nov 02 12:54:17.627069 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 147/315] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:17 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:17.659040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:17.666873 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-944426f6-2c03-43b2-9d77-86511490f384 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.165503 Nov 02 12:54:17.667440 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 169/316] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:17 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:18.291501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:18.292058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:18.300059 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.300548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.301318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.301750 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.373595 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:18.385803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6eb3aa26-22fb-4b6c-83a9-5ad8b0d76a06 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1266 microversion: 2.1 time: 0.100029 Nov 02 12:54:18.386551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 148/317] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:18 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:18.458852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:18.459492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:18.466307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.466756 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.467671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.467946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.617572 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:18.625985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f5b8a601-2f51-4af4-b314-9e1b496006b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.171915 Nov 02 12:54:18.626387 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 170/318] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:18 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:18.649974 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:18.650677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:18.656778 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.657222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.657967 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.658391 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.689988 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:18.690660 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:18.696890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.697334 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.698088 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:18.698514 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:18.725038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:18.733571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-271e01cc-a7c4-4056-bf6d-068ea1b7cdde tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.087603 Nov 02 12:54:18.734177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 149/319] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:18 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:18.833721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:18.841992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-06364cd4-3e78-4d69-8f5e-d7b9b2d5fc44 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.155947 Nov 02 12:54:18.842586 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 171/320] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:18 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:19.412018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:19.412692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:19.419782 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.420233 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.421027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.421454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.482585 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:19.491867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0cac10d3-dac6-45d3-bb3d-4608e86820f7 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1266 microversion: 2.1 time: 0.083816 Nov 02 12:54:19.492471 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 150/321] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:19 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:19.653526 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:19.654690 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:19.662976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.663425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.664193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.664630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.756687 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:19.757343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:19.763944 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.764425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.765191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.765620 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.830026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:19.839545 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f4e8edaf-2602-4903-abe1-df147324a3e8 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.086883 Nov 02 12:54:19.840134 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 151/322] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:19 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:19.866243 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:19.866857 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:19.873550 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.874001 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.874794 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:19.875219 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:19.968264 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:19.976272 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cc7c0166-05f4-411c-ade3-6b1125b115cf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.329326 Nov 02 12:54:19.977050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 172/323] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:19 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:20.018017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:20.027930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-881fa09a-d150-4789-87f8-82667770f512 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.166382 Nov 02 12:54:20.029245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 152/324] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:19 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:20.515336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:20.515936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:20.523058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:20.523512 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:20.524366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:20.525003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:20.585059 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:20.592783 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5cd166fb-4992-4d42-a36a-20540163c2cc tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1266 microversion: 2.1 time: 0.081298 Nov 02 12:54:20.593516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 173/325] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:20 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:20.863087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:20.863638 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:20.870757 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:20.871200 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:20.871967 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:20.872429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:20.938569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:20.947065 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-15811b8b-48de-4615-9faa-f741d401aaa7 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.088098 Nov 02 12:54:20.947673 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 153/326] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:20 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:21.000444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:21.001043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:21.008085 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.008542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:21.009324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.009754 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:21.056331 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:21.056928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:21.065187 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.065649 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:21.066729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.067229 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:21.155764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:21.163777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-30d448b6-a496-4553-b7c9-809d676445fa tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.167697 Nov 02 12:54:21.164488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 174/327] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:20 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:21.213072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:21.224087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8a692d6b-2fc9-4bfd-9d6f-8719662aeec5 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.173013 Nov 02 12:54:21.224876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 154/328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:21 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:21.623328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:21.623815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:21.630436 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.630889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:21.631702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.632151 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:21.693625 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:21.701563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4493b1ce-d2cc-4a60-82a6-e8f020934260 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1272 microversion: 2.1 time: 0.082434 Nov 02 12:54:21.702140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 175/329] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:21 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:21.970624 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:21.971237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:21.978396 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.978833 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:21.979524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:21.979964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:22.072041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:22.080524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-90cb9ae7-fc5f-4d5f-a003-5b0bb2ad8e43 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.113814 Nov 02 12:54:22.081303 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 155/330] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:21 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:22.187329 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:22.187976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:22.194812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:22.195256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:22.196029 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:22.196569 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:22.248846 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:22.249617 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:22.256319 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:22.256969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:22.258001 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:22.258618 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:22.337087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:22.344903 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fab7e7b7-5844-4e9d-bdd9-713b3d034acb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.161580 Nov 02 12:54:22.345511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 176/331] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:22 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:22.464752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:22.473240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c63376c2-dc57-4234-8c88-3d8ca594ff83 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.229866 Nov 02 12:54:22.473817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 156/332] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:22 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:22.729225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:22.730263 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:22.739984 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:22.740471 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:22.741322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:22.741773 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:22.883155 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:22.890793 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0d8b5274-98f1-4337-84d0-f73139f6bddb tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.168129 Nov 02 12:54:22.891336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 177/333] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:22 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:23.108607 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:23.109352 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:23.120374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.121132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:23.122430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.123139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:23.191599 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:23.200405 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2a5cc122-eb29-4533-978c-fba8c17c9a86 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.098847 Nov 02 12:54:23.201000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 157/334] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:23 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:23.372713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:23.373508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:23.382425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.382872 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:23.383643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.384076 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:23.497472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:23.498306 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:23.505173 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.505637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:23.506414 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.506863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:23.532034 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:23.539724 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cfe04520-74bf-4aad-a63e-fa49f8a4c32b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.173931 Nov 02 12:54:23.540387 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 178/335] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:23 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:23.647809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:23.655819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-658c90ff-5886-49a5-a8e4-ab38e3f781cc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.163378 Nov 02 12:54:23.656438 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 158/336] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:23 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:23.917371 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:23.918023 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:23.926076 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.926638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:23.927593 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:23.928145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:24.063405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:24.070883 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3c7e0eda-e236-4516-a034-7391f7f9088a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.158506 Nov 02 12:54:24.071413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 179/337] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:23 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:24.235145 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:24.236186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:24.244101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:24.244567 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:24.245350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:24.245784 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:24.318114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:24.326576 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-38affff9-4c5f-4e2b-b866-73802e6e670b tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.098008 Nov 02 12:54:24.327146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 159/338] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:24 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:24.564894 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:24.565431 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:24.572010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:24.572499 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:24.573293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:24.573718 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:24.679034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:24.679663 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:24.686244 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:24.686689 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:24.687448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:24.687973 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:24.718073 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:24.725897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c977f9ec-c5b4-4cdd-ae1f-7b07a8a205ce tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.165189 Nov 02 12:54:24.726499 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 180/339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:24 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:24.826494 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:24.838577 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a4daf983-f7d6-43a9-bb79-2002c80324a7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.163343 Nov 02 12:54:24.839346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 160/340] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:24 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:25.095100 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:25.095614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:25.102035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.102477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.103226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.103649 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.247394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:25.258542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1d567ffc-b4f1-4390-8d4e-ff14f1ebed63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.167241 Nov 02 12:54:25.259269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 181/341] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:25 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:25.351452 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:25.352132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:25.361150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.361734 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.362780 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.363352 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.435054 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:25.445982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-11794846-1b0a-4142-a238-1dcbab624b55 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.099654 Nov 02 12:54:25.446550 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 161/342] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:25 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:25.753582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:25.754517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:25.765434 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.766180 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.767663 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.768425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.862235 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:25.862849 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:25.869672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.870138 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.870908 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:25.871343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:25.906962 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:25.914896 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8aca1c10-e394-4452-9866-822aae4a7d95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.167899 Nov 02 12:54:25.915525 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 182/343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:25 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:26.011502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:26.021368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b5b5facc-8119-4e18-a1c9-10e1300ec649 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.163171 Nov 02 12:54:26.022018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 162/344] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:25 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:26.289575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:26.290090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:26.296806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:26.297261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:26.298036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:26.298468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:26.447558 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:26.459025 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b7b96a58-2c49-4cf8-8860-c7296b15c1ea tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.175344 Nov 02 12:54:26.459925 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 183/345] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:26 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:26.468719 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:26.469346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:26.476277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:26.476763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:26.477577 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:26.478017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:26.544409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:26.552720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d457f714-3885-4a07-8702-67516b41b7fd tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.087886 Nov 02 12:54:26.553268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 163/346] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:26 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:26.938394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:26.938975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:26.945733 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:26.946182 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:26.946963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:26.947399 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.045168 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:27.045778 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:27.051883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:27.052354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.053156 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:27.053728 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.084980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:27.093528 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aace0bc7-33a6-4924-b4cb-b021e20215ec tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.159079 Nov 02 12:54:27.094108 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 184/347] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:26 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:27.306466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:27.314437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2e7efa20-55b8-4077-992c-37e74ed78c5e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.273186 Nov 02 12:54:27.315216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 164/348] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:27 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:27.326382 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-6519d453-229a-4b0c-aea1-268385a7de20 req-b7928a31-fd2b-4b75-ac66-eef090cc7007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8362ec-1f17-48f6-8504-afecca67a61f", "tag": "c074d7a0-ff6b-442f-986c-61ef7a9eafd3"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:27.334859 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6519d453-229a-4b0c-aea1-268385a7de20 req-b7928a31-fd2b-4b75-ac66-eef090cc7007 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:27.335322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6519d453-229a-4b0c-aea1-268385a7de20 req-b7928a31-fd2b-4b75-ac66-eef090cc7007 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.346578 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-6519d453-229a-4b0c-aea1-268385a7de20 req-b7928a31-fd2b-4b75-ac66-eef090cc7007 service nova] Creating event network-changed:c074d7a0-ff6b-442f-986c-61ef7a9eafd3 for instance 6d8362ec-1f17-48f6-8504-afecca67a61f on hv-cinder-86327 Nov 02 12:54:27.351722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-6519d453-229a-4b0c-aea1-268385a7de20 req-b7928a31-fd2b-4b75-ac66-eef090cc7007 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028984 Nov 02 12:54:27.352550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 185/349] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:54:27.485730 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:27.486637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:27.495152 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:27.495598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.496432 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:27.496858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.575653 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:27.576368 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:27.582439 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:27.582879 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.583642 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:27.584069 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:27.648952 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:27.657181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-033cd534-7a09-4b61-9982-31c9c2b623b2 tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1346 microversion: 2.1 time: 0.085760 Nov 02 12:54:27.657815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 186/350] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:27 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:27.668117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:27.676467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c6c74dbe-8456-4893-953c-6536a0e38f48 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.196468 Nov 02 12:54:27.677046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 165/351] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:27 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:28.119427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:28.120071 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:28.126755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.127195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.127960 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.128774 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.268659 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:28.279129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bbb871ba-4ae8-4f01-b135-2dd1a833e745 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.164843 Nov 02 12:54:28.279713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 187/352] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:28 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:28.338402 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:28.339096 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:28.345660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.346218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.346989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.347420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.605170 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:28.613847 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-42ab3026-dfbc-482a-be25-19093e95817c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.279581 Nov 02 12:54:28.614890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 166/353] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:28 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:28.685885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:28.685885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:28.688063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.688623 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.689525 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.690019 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.701786 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:28.702760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:28.717261 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.719353 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.720379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.721204 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.722228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:28.722740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:28.723246 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lazy-loading 'fault' on Instance uuid 980d235a-d1e0-4688-97c4-2e18bb50b977 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:28.765984 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0b35be3944451d961e68ed1e39afc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2c4b25d8f447e99927fa32e9f35b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:28.775365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2b903276-023f-4998-83bd-d50f72e1e47d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 200 len: 1351 microversion: 2.1 time: 0.099077 Nov 02 12:54:28.775960 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 188/354] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:28 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:28.893937 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:28.902247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2c50a7b8-1856-4814-80ed-0342d54d0a63 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.205080 Nov 02 12:54:28.902817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 167/355] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:28 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:29.305803 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:29.306442 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:29.313042 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.313591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.314431 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.314923 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.473195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:29.480904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c2092816-0c62-4d47-b1a0-70f88cc9c36d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.179467 Nov 02 12:54:29.481468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 189/356] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:29 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:29.640251 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:29.641089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:29.649871 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.650323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.651087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.651518 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.795972 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:29.799153 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:29.799838 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:29.805007 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3c277e66-cd95-4bb2-a91f-ef6fe9cf0807 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.169947 Nov 02 12:54:29.805649 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 168/357] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:29 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:29.817556 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.818053 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.818992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.819542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.833815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] HTTP exception thrown: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. Nov 02 12:54:29.834423 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Returning 404 to user: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:54:29.835426 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-097933b7-56f0-4545-9cf9-452a3c4d8bdc tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 404 len: 111 microversion: 2.1 time: 0.041181 Nov 02 12:54:29.835998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 190/358] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:29 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:29.926173 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:29.927009 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:29.934027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.934628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.935471 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.935907 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.954701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:29.955764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:29.962253 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.962826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:29.963677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:29.964225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:30.028557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] HTTP exception thrown: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. Nov 02 12:54:30.029073 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Returning 404 to user: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:54:30.032452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3ddc7536-8af3-4315-beba-1a931697a48d tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.079195 Nov 02 12:54:30.033817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 191/359] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 12:54:29 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977/os-volume_attachments => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:30.085990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.093774 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e71c9ce8-0833-4476-808d-28dda93b512f tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.172555 Nov 02 12:54:30.094300 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 169/360] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:29 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:30.504945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.505521 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:30.513398 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:30.513980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:30.514856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:30.515312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:30.658976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.667218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cb0912d9-b278-4a11-946b-aec5b6beead8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.166214 Nov 02 12:54:30.667792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 192/361] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:30.828572 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:30.830238 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:30.842264 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:30.842896 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:30.843961 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:30.844556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:30.985280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:30.994858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c22a65e8-c528-42f7-92ab-b880540a6aaf tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.170374 Nov 02 12:54:30.995437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 170/362] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:30 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:31.116944 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:31.118338 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:31.125157 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:31.125667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:31.126422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:31.126849 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:31.270892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:31.278678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d21af65e-321f-4129-9a9a-c4bbf5e73c51 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.166029 Nov 02 12:54:31.279320 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 193/363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:31 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:31.691201 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:31.691841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:31.698514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:31.698965 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:31.699724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:31.700158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:31.848883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:31.860906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dcc61cc4-d85a-410c-b650-8008c0574657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.173352 Nov 02 12:54:31.861581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 171/364] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:31 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:32.024196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:32.026636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:32.036028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:32.036825 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:32.038060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:32.038498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:32.177421 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:32.185401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2abc195b-863f-4ed6-bc79-e555f6a20e2d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.168958 Nov 02 12:54:32.185972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 194/365] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:32 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:32.306087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:32.306960 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:32.314452 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:32.315141 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:32.316087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:32.316651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:32.452068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:32.460108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-68112e26-c13e-469a-bd28-05caa4f6b8d1 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.158923 Nov 02 12:54:32.460722 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 172/366] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:32 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:32.888634 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:32.889394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:32.897827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:32.898380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:32.899347 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:32.899880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:33.049461 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:33.057889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-02330095-ba8b-4ae4-86b7-be7342309714 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.174344 Nov 02 12:54:33.058468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 195/367] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:32 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:33.211978 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:33.212586 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:33.219415 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:33.219863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:33.220657 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:33.221116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:33.374129 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:33.381813 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a5115aa0-e2c2-49fb-b913-2d999077e11d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.176099 Nov 02 12:54:33.382421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 173/368] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:33 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:33.484147 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:33.484804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:33.491485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:33.491936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:33.492764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:33.493202 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:33.638258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:33.650783 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-41a82d8c-c837-42e9-9e98-3f0db827b9dd tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.170401 Nov 02 12:54:33.651726 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 196/369] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:33 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:34.082031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:34.082671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:34.089765 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:34.090212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:34.090983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:34.091402 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:34.236608 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:34.244834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-abc4aaea-bc20-4648-b87e-addf7e1761e1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.167034 Nov 02 12:54:34.245551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 174/370] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:34 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:34.405584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:34.406204 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:34.412979 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:34.413516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:34.414272 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:34.414700 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:34.556222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:34.564499 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-26c0af0b-64d3-42d0-8367-453b473738ef tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.162992 Nov 02 12:54:34.565070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 197/371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:34 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:34.683211 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:34.683818 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:34.690899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:34.691349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:34.692114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:34.692583 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:34.830440 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:34.838426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e8f40749-4797-4b13-aeec-4bb5e40e533e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.161809 Nov 02 12:54:34.839181 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 175/372] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:34 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:35.278338 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:35.278969 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:35.285874 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:35.286331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:35.287114 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:35.287667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:35.442541 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:35.454981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6092a176-6b4a-4c81-bdcb-0ed2a115abcd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.182683 Nov 02 12:54:35.455572 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 198/373] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:35 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:35.586943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:35.587513 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:35.594402 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:35.594843 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:35.595603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:35.595987 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:35.737892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:35.745503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1f1891b4-2b5a-4579-a76b-15db1e5926e4 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.162533 Nov 02 12:54:35.746085 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 176/374] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:35 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:35.862095 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:35.862692 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:35.869166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:35.869617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:35.870389 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:35.870823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:36.011975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:36.020180 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-326f7c2e-28e8-42a3-9191-735084a6a8d8 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.161815 Nov 02 12:54:36.020758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 199/375] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:35 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:36.481932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:36.482545 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:36.489110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:36.489551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:36.490338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:36.490764 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:36.632433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:36.641745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4c7546bc-2a39-4d16-87c3-9589e6e2833f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.165236 Nov 02 12:54:36.642496 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 177/376] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:36 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:36.772836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:36.773764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:36.781992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:36.782465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:36.783218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:36.783648 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:36.926338 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:36.934033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d86a4e43-62de-4d47-8098-c01cebcd87c2 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.168561 Nov 02 12:54:36.934601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 200/377] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:36 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:37.048034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:37.048957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:37.059662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.060131 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.060935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.061414 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.210639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:37.222070 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1ee6e651-f941-4af2-b977-72d898c93ad0 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.180689 Nov 02 12:54:37.222871 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 178/378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:37 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:37.598876 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:37.599402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:37.605475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.605924 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.606701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.607136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.620961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] HTTP exception thrown: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. Nov 02 12:54:37.621591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Returning 404 to user: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:54:37.622505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-12cbf609-e948-4a58-8342-62dd3aa52f9f tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "DELETE /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 404 len: 111 microversion: 2.1 time: 0.027646 Nov 02 12:54:37.623078 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 201/379] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 12:54:37 2022] DELETE /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:37.631688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:37.632361 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] [instance: 980d235a-d1e0-4688-97c4-2e18bb50b977] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:37.638946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.639507 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.640160 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.640627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.654607 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] HTTP exception thrown: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. Nov 02 12:54:37.655250 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] Returning 404 to user: Instance 980d235a-d1e0-4688-97c4-2e18bb50b977 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:54:37.656086 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-be6e7c49-0d01-4bd2-985f-4f2618c7bcef tempest-DeleteServersTestJSON-61931598 tempest-DeleteServersTestJSON-61931598-project] 10.222.0.90 "GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977" status: 404 len: 111 microversion: 2.1 time: 0.028496 Nov 02 12:54:37.656664 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 179/380] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:37 2022] GET /compute/v2.1/servers/980d235a-d1e0-4688-97c4-2e18bb50b977 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:37.666176 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:37.666862 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:37.673328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.673851 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.674713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.675243 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.817067 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:37.825534 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-db7ef525-e362-401f-a20d-1652b9961ae4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.163319 Nov 02 12:54:37.826207 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 202/381] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:37 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:37.956994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:37.957604 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:37.964455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.964905 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:37.965669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:37.966100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:38.215747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:38.223560 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a7d4776e-c07f-44cf-bba9-032ead5eac26 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.270405 Nov 02 12:54:38.224150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 180/382] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:37 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:38.246785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:38.247424 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:38.253935 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:38.254415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:38.255176 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:38.255603 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:38.404041 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:38.412441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-34481165-ce11-4089-8389-c48867ee0e4b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.169750 Nov 02 12:54:38.413052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 203/383] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:38 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:38.849457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:38.850350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:38.857368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:38.858016 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:38.858803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:38.859235 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:39.162351 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:39.170083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e0bc8507-238f-4713-b4b7-3617951712ab tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.324643 Nov 02 12:54:39.170637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 181/384] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:38 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:39.247322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:39.248142 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:39.254976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:39.255388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:39.256429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:39.256866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:39.426856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:39.435098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a70182d1-1173-47be-8187-0949a15e2183 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.191865 Nov 02 12:54:39.435433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:39.436002 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 204/385] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:39 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:39.440966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:39.448325 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:39.449042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:39.450211 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:39.450815 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:39.691184 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:39.717788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c0666acf-0a0b-4503-b573-58adb8beca42 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.286445 Nov 02 12:54:39.719209 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 182/386] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:39 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:40.192705 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:40.193301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:40.206589 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:40.207255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:40.208033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:40.208507 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:40.358878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:40.368517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8a13319c-3021-4d4c-b764-43b75950134f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.179608 Nov 02 12:54:40.369346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 205/387] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:40 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:40.459571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:40.463557 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:40.473872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:40.475310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:40.476488 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:40.477166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:40.744671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:40.745422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:40.750267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:40.752659 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:40.753324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:40.754388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:40.754992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:40.766097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d6e5e5a2-b218-4f9b-b10d-267c7ba8227a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.311495 Nov 02 12:54:40.772124 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 183/388] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:40 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:40.930702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:40.939542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2ded811e-9c45-41b6-880d-7d6fa24c68b4 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.200868 Nov 02 12:54:40.940792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 206/389] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:40 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:41.392081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:41.393101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:41.399955 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:41.400756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:41.401852 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:41.402491 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:41.795748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:41.798187 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:41.812815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:41.813828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:41.815133 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:41.817035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:41.995428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:42.028317 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5a0d2100-3f0d-4f99-8440-a3e99d9f6ca0 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.639901 Nov 02 12:54:42.037960 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 184/390] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:41 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:42.045698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:42.064104 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:42.076614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:42.077791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:42.079372 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:42.080943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:42.196880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:42.206773 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3a86c181-3e61-4588-be47-dc6444537edd tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.416153 Nov 02 12:54:42.224110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 207/391] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:41 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:42.298088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:42.306389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-be2ff786-d031-4ddd-a022-5501e9686ef6 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.267007 Nov 02 12:54:42.324190 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 185/392] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:42 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:43.062295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:43.063492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:43.076745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:43.077631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:43.078581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:43.079164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:43.231753 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:43.232599 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:43.240574 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:43.241038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:43.241893 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:43.242681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:43.410326 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:43.419740 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-72f1a2af-74bc-40a7-b87b-89edc00eee87 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.191904 Nov 02 12:54:43.420656 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 186/393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:43 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:43.425464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:43.426327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:43.434587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:43.435037 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:43.435822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:43.436263 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:43.542997 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:43.553692 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aeadf5e9-4297-4dcc-b8e0-9f3c4a956d15 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.494266 Nov 02 12:54:43.559132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 208/394] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:43 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:43.647742 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:43.678575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ecc0e989-fa72-49dd-bfd8-782dfcc8aa81 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.256632 Nov 02 12:54:43.679559 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 187/395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:43 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:44.443450 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:44.444122 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:44.452647 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:44.453212 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:44.454092 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:44.454597 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:44.582022 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:44.583249 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:44.591058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:44.591534 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:44.592691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:44.593131 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:44.705410 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:44.723668 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-735b57e4-3fb5-49b6-848c-b5ccc16d1059 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.282016 Nov 02 12:54:44.741554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 209/396] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:44 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:44.750420 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:44.752020 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:44.754993 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:44.759580 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:44.760366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:44.761793 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:44.762444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:44.762844 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dd7bc299-b6c4-40c5-a5b9-68be5973b23e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.185796 Nov 02 12:54:44.763417 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 188/397] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:44 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:44.940838 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-59ce2c87-cf90-460c-bd6f-e03300eea7cc req-0543aaf7-fad6-46b5-ada2-89f04da4507f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f561ba4f-0814-475b-8ad1-5e79cfe5b851", "name": "network-vif-plugged", "status": "completed", "tag": "f9228980-d82d-4aaa-a38d-0af21963a57f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:44.968009 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-59ce2c87-cf90-460c-bd6f-e03300eea7cc req-0543aaf7-fad6-46b5-ada2-89f04da4507f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:44.969087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-59ce2c87-cf90-460c-bd6f-e03300eea7cc req-0543aaf7-fad6-46b5-ada2-89f04da4507f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:44.998188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-59ce2c87-cf90-460c-bd6f-e03300eea7cc req-0543aaf7-fad6-46b5-ada2-89f04da4507f service nova] Creating event network-vif-plugged:f9228980-d82d-4aaa-a38d-0af21963a57f for instance f561ba4f-0814-475b-8ad1-5e79cfe5b851 on hv-cinder-86327 Nov 02 12:54:45.018629 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-59ce2c87-cf90-460c-bd6f-e03300eea7cc req-0543aaf7-fad6-46b5-ada2-89f04da4507f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077463 Nov 02 12:54:45.019954 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 189/398] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:45.167001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:45.175077 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1f74c66f-32a0-4ec2-b4ab-1753921ef301 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.431687 Nov 02 12:54:45.175933 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 210/399] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:44 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:45.754942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:45.756502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:45.763670 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:45.764114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:45.764924 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:45.765350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:45.793028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:45.794316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:45.802414 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:45.803523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:45.804413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:45.805161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:45.925343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:45.934104 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0850d47b-fbb9-4bb3-a8f0-b0ab4cfc5b04 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.183259 Nov 02 12:54:45.935397 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 190/400] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:45 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:46.037407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:46.045340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b57fd81f-ecef-4754-800b-5342f494158f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.262221 Nov 02 12:54:46.060384 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 211/401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:45 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:46.199346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:46.199963 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:46.206963 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:46.207964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:46.209548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:46.210080 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:46.406788 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-65736842-7cd0-42dc-b439-70d9909b3e9a tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe43b0ad30>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:46.463441 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:46.468908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-65736842-7cd0-42dc-b439-70d9909b3e9a tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/230a53a5-4b55-436f-8c6d-30cfeec2c2df" status: 200 len: 351 microversion: 2.1 time: 0.067691 Nov 02 12:54:46.477742 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 212/402] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:54:46 2022] GET /compute/v2.1/os-volumes/230a53a5-4b55-436f-8c6d-30cfeec2c2df => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:54:46.477931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8d61e3a5-e3ab-42d0-9c1e-edd467db2bce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.280185 Nov 02 12:54:46.477931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 191/403] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:46 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:46.958243 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:46.958879 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:46.965352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:46.966688 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:46.967652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:46.968871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:47.071244 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:47.071863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:47.079264 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:47.080347 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:47.081513 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:47.081949 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:47.261438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:47.273894 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bd1cb8e4-6853-4e6a-8ac3-b61ed63b9dfb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.318286 Nov 02 12:54:47.277018 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 213/404] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:46 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:47.330678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:47.339892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ab4768bd-79dc-4f88-b379-8800dc3f4440 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1521 microversion: 2.1 time: 0.272708 Nov 02 12:54:47.340526 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 192/405] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:47 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:47.506471 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:47.507532 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:47.514491 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:47.515026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:47.516634 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:47.516963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:47.757621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:47.766875 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1b563ef7-34f6-46ef-b92b-040624899530 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.269505 Nov 02 12:54:47.768288 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 214/406] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:47 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:48.300003 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:48.302269 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:48.332105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.334931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.336036 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.337677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.364740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:48.366432 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:48.380519 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.381656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.383551 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.383970 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.617080 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:48.627315 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd58928a-f624-485e-a8bd-453b16eb3cdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1318 microversion: 2.1 time: 0.332089 Nov 02 12:54:48.627946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 193/407] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:48 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:48.683382 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:48.691678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-edea05c9-7412-46cd-9477-d896d006e5ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1501 microversion: 2.1 time: 0.331708 Nov 02 12:54:48.701792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 215/408] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:48 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1501 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:54:48.723826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:48.724799 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:48.744940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.745421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.746394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.747158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.797076 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:48.798629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:48.809509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.810268 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.811544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:48.812232 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:48.943133 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:48.952613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0a6221d3-8d76-4218-ade3-da2b894a387d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1516 microversion: 2.1 time: 0.234629 Nov 02 12:54:48.953194 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 194/409] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:48 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1516 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:49.032423 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-716704d5-d552-4054-8856-8959d98b4bcb tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe42795ca0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:49.092430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-716704d5-d552-4054-8856-8959d98b4bcb tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3a4bc172-3861-49e0-aca3-071524dd7b0f" status: 200 len: 350 microversion: 2.1 time: 0.063835 Nov 02 12:54:49.093089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 195/410] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:54:49 2022] GET /compute/v2.1/os-volumes/3a4bc172-3861-49e0-aca3-071524dd7b0f => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:54:49.155515 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:49.168397 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6776ad30-3c40-4a24-b6d8-77780a7aeb64 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.380777 Nov 02 12:54:49.171185 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 216/411] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:48 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:49.653771 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:49.655098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:49.665431 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:49.666378 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:49.668457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:49.669152 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:49.943265 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:49.952224 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-799b7cd7-3a50-4fc4-b8b8-0f696c4b1bdb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1507 microversion: 2.1 time: 0.303998 Nov 02 12:54:49.971442 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 196/412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:49 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:50.196719 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:50.197630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:50.208724 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:50.210035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:50.213691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:50.214334 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:50.794727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:50.807148 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c8ddc68f-3174-449d-b9f4-9152db660e2a tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.615869 Nov 02 12:54:50.810925 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 217/413] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:50 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:51.715240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-8e25dabd-31bd-494c-8674-9c9079879727 req-c48ed2d3-4d9e-4506-9c73-b864259bcbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8362ec-1f17-48f6-8504-afecca67a61f", "name": "network-vif-plugged", "status": "completed", "tag": "c074d7a0-ff6b-442f-986c-61ef7a9eafd3"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:51.743088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8e25dabd-31bd-494c-8674-9c9079879727 req-c48ed2d3-4d9e-4506-9c73-b864259bcbc4 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:51.745208 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8e25dabd-31bd-494c-8674-9c9079879727 req-c48ed2d3-4d9e-4506-9c73-b864259bcbc4 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:51.759260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-8e25dabd-31bd-494c-8674-9c9079879727 req-c48ed2d3-4d9e-4506-9c73-b864259bcbc4 service nova] Creating event network-vif-plugged:c074d7a0-ff6b-442f-986c-61ef7a9eafd3 for instance 6d8362ec-1f17-48f6-8504-afecca67a61f on hv-cinder-86327 Nov 02 12:54:51.771087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:51.772408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:51.792992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-8e25dabd-31bd-494c-8674-9c9079879727 req-c48ed2d3-4d9e-4506-9c73-b864259bcbc4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083529 Nov 02 12:54:51.806713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 197/414] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:51.823355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:51.825414 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:51.827738 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:51.828342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:51.839803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:51.840866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:51.859987 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:51.891765 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:51.892832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:51.893684 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:51.953764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lazy-loading 'flavor' on Instance uuid 28d7f87e-6c63-40ee-9bf3-e454b81d34ee {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:54:52.147610 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-14623801-ab69-44c9-b727-ce7941c646b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee/action" status: 200 len: 32 microversion: 2.1 time: 0.380962 Nov 02 12:54:52.149246 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 218/415] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:54:51 2022] POST /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee/action => generated 32 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:54:52.160942 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a8856c61-624a-4e52-9fb7-1931246b1e2d tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe420b3040>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:52.281621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a8856c61-624a-4e52-9fb7-1931246b1e2d tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/690c5eed-2338-43ed-81b7-1c9b51b68e5e" status: 200 len: 350 microversion: 2.1 time: 0.130760 Nov 02 12:54:52.282215 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 219/416] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 12:54:52 2022] GET /compute/v2.1/os-volumes/690c5eed-2338-43ed-81b7-1c9b51b68e5e => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:52.288729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:52.289743 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:52.312891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:52.313345 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:52.314862 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:52.315311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:52.542225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:52.555204 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-363422fe-3904-4c02-835c-7f2ade779845 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.271111 Nov 02 12:54:52.556429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 220/417] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:52 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:52.567508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e078bf77-69a6-444e-9e90-825c326556d7 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe4297e4c0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:52.670656 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:52.680501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3e0b2118-3cf5-4020-a024-724dcf4477ce tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.845376 Nov 02 12:54:52.682074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 198/418] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:51 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:52.688918 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e078bf77-69a6-444e-9e90-825c326556d7 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.124162 Nov 02 12:54:52.689808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 221/419] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Nov 2 12:54:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:52.708917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6907b8d4-d130-4e70-a480-8ce5340ad00e tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe42790550>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:52.863731 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6907b8d4-d130-4e70-a480-8ce5340ad00e tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.158576 Nov 02 12:54:52.864880 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 199/420] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Nov 2 12:54:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:52.886013 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b54f1a42-e2e4-4fde-a027-09906f0e3def tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe420238b0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.066733 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b54f1a42-e2e4-4fde-a027-09906f0e3def tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.184781 Nov 02 12:54:53.068047 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 222/421] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Nov 2 12:54:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:53.081920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-978601e0-d518-441d-9a6d-b007b66e044a tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe42785550>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.243831 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-978601e0-d518-441d-9a6d-b007b66e044a tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.165901 Nov 02 12:54:53.245146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 200/422] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:53.267308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a6460e96-7f5b-4320-b616-4a4c1e0f0ad1 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe420239d0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.446589 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a6460e96-7f5b-4320-b616-4a4c1e0f0ad1 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.183211 Nov 02 12:54:53.447431 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 223/423] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:53.477430 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b101cf03-024e-4259-88c8-eb62536c61d8 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe4204c550>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.615035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b101cf03-024e-4259-88c8-eb62536c61d8 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.154413 Nov 02 12:54:53.615841 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 224/424] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:53.628159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.628808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:53.636091 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:53.636571 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:53.637342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:53.637767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:53.690191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e9aeca50-517d-4abf-a3f6-c7e55449234f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Action: 'create', calling method: .version_select at 0x7fbe427950d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2037140484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx/jVfTBmnQ5OxnqXNfuf4BA7VHMb1vnNOvRnXEOK7gq0OY9ltbaXvPBxIRF/su5saqRKuDzfrUz+TUXUgpa4caCl/PLWer/HJimSwybIXYpw7W3XQgSL2luhawbJI5vg=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:54:53.726244 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-e9aeca50-517d-4abf-a3f6-c7e55449234f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:54:53.731260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-e9aeca50-517d-4abf-a3f6-c7e55449234f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for user 8c01ed6e76ef4ee4ba5356c526e113e4 and project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:54:53.758976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e9aeca50-517d-4abf-a3f6-c7e55449234f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.360037 Nov 02 12:54:53.766036 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 201/425] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 12:54:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:54:53.772183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c4b09a4e-690f-4b01-a0f8-e00bc59c1f69 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe427ea4c0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.888951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:53.899161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ce347598-d644-4e8f-81f1-62c4e3692bbb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.282139 Nov 02 12:54:53.900009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 225/426] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:53.922256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:53.922880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:53.923459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c4b09a4e-690f-4b01-a0f8-e00bc59c1f69 tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.155946 Nov 02 12:54:53.924349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 202/427] 10.222.0.90 () {58 vars in 1188 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:54:53.935103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:53.936383 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:53.937476 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:53.938511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:53.942926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-013296b0-d6ac-4fb2-a468-9d2bb563444b tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] Calling method '.version_select at 0x7fbe4279ee50>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:54.120424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-013296b0-d6ac-4fb2-a468-9d2bb563444b tempest-VolumesTestJSON-1795261692 tempest-VolumesTestJSON-1795261692-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.181213 Nov 02 12:54:54.121108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 203/428] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:54.158641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:54.171259 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3d297885-b361-47a2-a94d-337718fa7bc2 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1314 microversion: 2.1 time: 0.258450 Nov 02 12:54:54.177032 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 226/429] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:53 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:54.924966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:54.926320 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:54.934901 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:54.935466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:54.936415 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:54.936999 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:55.124120 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:55.138693 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-93790913-c8a9-4342-bf80-c069a66c1c1a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.217391 Nov 02 12:54:55.139273 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 204/430] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:54 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:55.202422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:55.202966 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:55.215685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:55.216400 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:55.217384 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:55.217997 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:55.417573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:55.426422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a7ac0d7c-d81a-4198-9c33-613a24650756 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1498 microversion: 2.1 time: 0.232025 Nov 02 12:54:55.427394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 227/431] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:55 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:56.163254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:56.164768 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:56.172948 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:56.173529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:56.174280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:56.174874 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:56.336242 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:56.344354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3a1261a4-dc8e-4488-afe7-48dc6f2d825b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.185308 Nov 02 12:54:56.345319 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 205/432] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:56 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:57.372017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:57.372643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:57.379112 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:57.379569 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:57.380376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:57.380834 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:57.530969 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:57.539349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d26a52d2-e242-4987-9a7b-b46b92b0576b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.171971 Nov 02 12:54:57.540004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 228/433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:57 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:57.652568 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:57.653755 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:57.662575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:57.663599 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:57.664850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:57.665290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:57.693154 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 12:54:57.784674 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0aeff36d-d284-4155-81c7-440e487fc55b tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 204 len: 0 microversion: 2.1 time: 0.133654 Nov 02 12:54:57.786330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 206/434] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 12:54:57 2022] DELETE /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:54:57.796283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:57.796596 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:57.805745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:57.806194 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:57.806977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:57.807410 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:57.994101 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:58.003897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-15f55a0f-d1a5-4918-9211-79b14af4484c tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1504 microversion: 2.1 time: 0.212614 Nov 02 12:54:58.004821 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 229/435] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:57 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:58.565858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:58.566744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:58.573743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:58.574718 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:58.575829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:58.576503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:58.743522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:58.756000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1bacb507-3b3a-4a13-b31d-698077267dda tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.196353 Nov 02 12:54:58.760627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 207/436] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:58 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:59.031365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:59.032704 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:59.039385 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:59.039842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:59.040653 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:59.041087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:59.198088 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:59.206319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-181fae63-9608-426b-ad03-e7cef0da7453 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1504 microversion: 2.1 time: 0.179003 Nov 02 12:54:59.207232 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 230/437] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:59 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:54:59.781112 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:54:59.781720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:54:59.788769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:59.789567 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:59.791184 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:54:59.792524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:54:59.962977 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:54:59.970779 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ac51a63c-99db-47f8-992c-820f3a13ffb3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.194921 Nov 02 12:54:59.971363 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 208/438] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:54:59 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:00.234093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:00.234691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:00.242196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:00.242861 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:00.243772 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:00.244403 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:00.444672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:00.452445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3185f235-55ac-4d0f-84fe-dc304397d880 tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1504 microversion: 2.1 time: 0.222203 Nov 02 12:55:00.453033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 231/439] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:00 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:00.995248 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:00.996038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:01.003785 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:01.004569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:01.007046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:01.007578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:01.334144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:01.342468 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a08a54b9-9b0b-4901-a98e-7cc5792b3000 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.351444 Nov 02 12:55:01.343455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 209/440] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:00 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:01.477049 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:01.478340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:01.484732 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:01.485452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:01.486234 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:01.486691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:01.575088 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77ffa9a7dd44cf9b00c53d1356e0567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c22011cb72447d49eaf0e623c2d423c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:01.640557 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-07f64c38-7d5d-4560-ab29-af7041c524da req-462b5844-8488-457b-a3eb-b64321a6b925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8362ec-1f17-48f6-8504-afecca67a61f", "name": "network-vif-deleted", "tag": "c074d7a0-ff6b-442f-986c-61ef7a9eafd3"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:01.648070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d69f272d-7af5-47fe-a30b-4f3651b7328e tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 200 len: 1462 microversion: 2.1 time: 0.175626 Nov 02 12:55:01.651481 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-07f64c38-7d5d-4560-ab29-af7041c524da req-462b5844-8488-457b-a3eb-b64321a6b925 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:01.652395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-07f64c38-7d5d-4560-ab29-af7041c524da req-462b5844-8488-457b-a3eb-b64321a6b925 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:01.652575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 232/441] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:01 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 1462 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:01.665613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-07f64c38-7d5d-4560-ab29-af7041c524da req-462b5844-8488-457b-a3eb-b64321a6b925 service nova] Creating event network-vif-deleted:c074d7a0-ff6b-442f-986c-61ef7a9eafd3 for instance 6d8362ec-1f17-48f6-8504-afecca67a61f on hv-cinder-86327 Nov 02 12:55:01.670980 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-07f64c38-7d5d-4560-ab29-af7041c524da req-462b5844-8488-457b-a3eb-b64321a6b925 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035009 Nov 02 12:55:01.671681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 210/442] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:55:02.368897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:02.369504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:02.382566 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:02.383405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:02.384684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:02.385299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:02.675900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:02.677179 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] [instance: 6d8362ec-1f17-48f6-8504-afecca67a61f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:02.687558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:02.689385 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:02.690730 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:02.691164 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:02.704991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] HTTP exception thrown: Instance 6d8362ec-1f17-48f6-8504-afecca67a61f could not be found. Nov 02 12:55:02.705795 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] Returning 404 to user: Instance 6d8362ec-1f17-48f6-8504-afecca67a61f could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:55:02.707316 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9815bc7d-2c02-4312-9ad6-9faa0138faef tempest-VolumesActionsTest-399472520 tempest-VolumesActionsTest-399472520-project] 10.222.0.90 "GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f" status: 404 len: 111 microversion: 2.1 time: 0.036129 Nov 02 12:55:02.708032 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 211/443] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:02 2022] GET /compute/v2.1/servers/6d8362ec-1f17-48f6-8504-afecca67a61f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:55:02.797203 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:02.806386 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4f4baaa2-40c2-44d5-8cb1-1c1356abe8b6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.441160 Nov 02 12:55:02.811423 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 233/444] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:02 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:03.836854 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:03.837450 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:03.844637 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:03.845335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:03.846072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:03.846668 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:04.010043 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:04.017714 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b0482308-a70f-4473-a2a2-9601d0d9c2c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.186521 Nov 02 12:55:04.018553 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 212/445] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:03 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:05.041915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:05.043372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:05.058705 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:05.060375 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:05.061218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:05.061657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:05.228044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:05.237011 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-851bda83-a27f-4083-8dde-59fea4afdce4 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.198748 Nov 02 12:55:05.237618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 234/446] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:05 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:06.260932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:06.261390 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:06.267861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:06.268343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:06.269655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:06.270228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:06.427770 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:06.438503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1a6772d3-1f72-4a13-aeab-d4b16a8599bf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.181827 Nov 02 12:55:06.439064 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 213/447] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:06 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:07.467832 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:07.468751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:07.474977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:07.475522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:07.476325 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:07.476759 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:07.622055 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:07.633454 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5e2407de-80fe-4361-a5d6-527d60ba130c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.174260 Nov 02 12:55:07.634438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 235/448] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:07 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:08.658613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:08.659275 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:08.666664 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:08.667117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:08.667938 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:08.668409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:08.821207 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:08.830026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cb611fe9-89c4-4c1b-9c77-a4f77ab71582 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.175919 Nov 02 12:55:08.830589 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 214/449] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:08 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:09.861124 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:09.868367 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:09.874830 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:09.875625 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:09.876469 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:09.876876 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:10.075376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:10.085318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d55ef949-1096-46ad-bd2d-2f2689114e2b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.232579 Nov 02 12:55:10.086546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 236/450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:09 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:11.112911 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:11.114215 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:11.123351 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:11.123916 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:11.124986 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:11.125487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:11.345834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:11.354809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d81b5ad7-24ad-4aa4-95a2-88d8311b7934 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.248173 Nov 02 12:55:11.355814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 215/451] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:11 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:12.379333 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:12.380764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:12.387163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:12.387652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:12.388459 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:12.388897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:12.532346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:12.541712 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c9f930a5-a0eb-42c0-9c27-4585e9335191 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.167323 Nov 02 12:55:12.542524 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 237/452] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:12 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:13.565910 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:13.566614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:13.574044 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:13.574497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:13.575282 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:13.575726 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:13.726723 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:13.734676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9aa6b615-6de5-42cf-afb2-a05f27a8ba07 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.172727 Nov 02 12:55:13.736536 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 216/453] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:13 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:14.759312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:14.759939 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:14.765945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:14.766389 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:14.767147 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:14.767574 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:14.901054 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:14.912479 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8981da48-276e-4584-94c1-cc2b68cdd93d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.157042 Nov 02 12:55:14.913100 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 238/454] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:14 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:15.939816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:15.940778 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:15.951014 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:15.951720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:15.953028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:15.953745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:16.106403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:16.114777 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7eae935f-2d70-4b36-961c-cd470f030361 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.180990 Nov 02 12:55:16.115344 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 217/455] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:15 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:17.143836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:17.144891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:17.153305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:17.153910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:17.154938 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:17.155511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:17.295136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:17.305655 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9e224d4f-afc4-4c92-bc4e-c4c62b68cc98 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.167233 Nov 02 12:55:17.306539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 239/456] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:17 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:18.333491 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:18.334446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:18.343105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:18.343568 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:18.344381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:18.344820 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:18.484998 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:18.496630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-89f20804-86de-42fb-84a0-ecd762b058cb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.169342 Nov 02 12:55:18.497419 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 218/457] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:18 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:19.523618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:19.524516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:19.531971 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:19.532521 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:19.533414 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:19.533907 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:19.680136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:19.687958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c2a84077-3114-42d6-a485-72b689cc55cc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.170309 Nov 02 12:55:19.688506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 240/458] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:19 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:20.711199 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:20.711809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:20.718755 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:20.719153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:20.719920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:20.720380 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:20.858313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:20.866005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b0a398a6-665f-4f5a-bfbb-485002e6264f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.159044 Nov 02 12:55:20.866797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 219/459] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:20 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:21.889801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:21.890412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:21.897246 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:21.897697 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:21.898471 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:21.898904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:22.034302 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:22.042453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a867e608-5042-4db9-8c34-04c4de284d45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.156572 Nov 02 12:55:22.043177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 241/460] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:21 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:23.066074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:23.066689 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:23.073201 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:23.073823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:23.074438 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:23.074916 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:23.228602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:23.236267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-75856a02-7a46-4420-8481-f157a8ce5a3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.173999 Nov 02 12:55:23.237256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 220/461] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:23 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:24.262527 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:24.263134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:24.269918 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:24.270349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:24.271535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:24.272168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:24.437213 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:24.446906 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f2dde15d-3bc8-43e4-ae69-2a01f8d0fb65 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.188277 Nov 02 12:55:24.448080 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 242/462] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:24 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:25.471729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:25.472328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:25.478628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:25.479064 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:25.479820 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:25.480294 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:25.672975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:25.682716 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-344becc1-a873-46da-bd52-a3e9ba3e582b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.214742 Nov 02 12:55:25.683984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 221/463] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:25 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:26.708945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:26.709848 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:26.718089 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:26.718763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:26.719831 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:26.720482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:26.871593 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:26.882627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ccd9fc63-db54-4a79-b7ca-999810845aae tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.178840 Nov 02 12:55:26.884990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 243/464] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:26 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:27.910284 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:27.910996 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:27.919216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:27.919691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:27.920649 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:27.921155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:28.068149 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:28.080365 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-27326957-70cf-4bff-8d0a-085df232cf54 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.174506 Nov 02 12:55:28.081153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 222/465] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:27 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:29.109729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:29.110358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:29.117484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:29.117905 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:29.118687 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:29.119113 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:29.268949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:29.277821 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-efdab226-02c4-43d5-ba8b-dacd5bc1c092 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.172962 Nov 02 12:55:29.278590 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 244/466] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:29 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:30.301416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:30.302033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:30.308927 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:30.309641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:30.311027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:30.311705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:30.458611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:30.466745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-784b2a20-3623-410a-8828-e8a3b029a3c1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.169265 Nov 02 12:55:30.467531 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 223/467] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:30 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:31.490665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:31.491673 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:31.499522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.499990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:31.500974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.501989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:31.654936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:31.673595 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d9f523d2-c806-479c-b8fb-04a8f865f7c5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1502 microversion: 2.1 time: 0.186975 Nov 02 12:55:31.680556 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 245/468] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:31 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:31.704724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "592b6467-c645-4b72-a45d-715d33eca7c2"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:31.705788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:31.712752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.713449 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:31.714222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.714829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:31.738099 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] HTTP exception thrown: Cannot 'attach_volume' instance 28d7f87e-6c63-40ee-9bf3-e454b81d34ee while it is in vm_state rescued Nov 02 12:55:31.738681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Returning 409 to user: Cannot 'attach_volume' instance 28d7f87e-6c63-40ee-9bf3-e454b81d34ee while it is in vm_state rescued {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:55:31.739687 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9520f555-dd83-45ae-9363-c1c478befd5d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039175 Nov 02 12:55:31.740456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 224/469] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 12:55:31 2022] POST /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:55:31.748854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-859767ad-7149-40bf-936a-f5a809aa9789 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:31.749382 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-859767ad-7149-40bf-936a-f5a809aa9789 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:31.755620 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-859767ad-7149-40bf-936a-f5a809aa9789 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.756071 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-859767ad-7149-40bf-936a-f5a809aa9789 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:31.756892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-859767ad-7149-40bf-936a-f5a809aa9789 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.757318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-859767ad-7149-40bf-936a-f5a809aa9789 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:31.838810 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-859767ad-7149-40bf-936a-f5a809aa9789 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee/action" status: 202 len: 0 microversion: 2.1 time: 0.093474 Nov 02 12:55:31.839600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 246/470] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:55:31 2022] POST /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:55:31.848837 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:31.849498 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:31.856000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.856429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:31.857200 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:31.857710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:32.103653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:32.111082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a1322065-6c96-4b49-bf7e-ba38f419cc2d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.266670 Nov 02 12:55:32.111646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 225/471] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:31 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:33.136273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:33.137770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:33.144979 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:33.145641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:33.146413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:33.146847 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:33.293293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:33.301096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a0bbc58a-dad9-452d-a71e-10170921ca47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.169306 Nov 02 12:55:33.301662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 247/472] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:33 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:34.327132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:34.329502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:34.340259 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:34.340976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:34.342018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:34.342462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:34.494581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:34.502324 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c82b0183-9e5c-43ba-a445-d57af83efb45 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.181046 Nov 02 12:55:34.502916 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 226/473] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:34 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:35.527730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:35.528546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:35.542124 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:35.542587 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:35.543388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:35.543837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:35.829125 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:35.843999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cc67a2dd-ba43-4aa2-8743-cfd184f012ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.320518 Nov 02 12:55:35.844516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 248/474] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:35 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:36.871681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:36.873056 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:36.883316 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:36.883975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:36.885028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:36.885641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:37.036411 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:37.046127 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0c5eb303-0204-4841-a9cb-d84626eafda7 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.178959 Nov 02 12:55:37.048149 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 227/475] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:36 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:38.072852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:38.073562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:38.079866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:38.080346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:38.081117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:38.082945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:38.283393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:38.292508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-219afc0c-16a5-403b-82cd-3d9b169e68ad tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.224017 Nov 02 12:55:38.293094 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 249/476] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:38 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:39.315128 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:39.315830 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:39.322370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:39.322822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:39.323592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:39.324024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:39.469514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:39.477660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-efa6ce01-032c-42d5-bc57-51fa09897c26 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.166461 Nov 02 12:55:39.478228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 228/477] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:39 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:40.505393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:40.506105 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:40.512564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:40.513021 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:40.513796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:40.514236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:40.666398 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:40.677574 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-21610890-5b3f-4fac-a4dd-3a8bf8f71af3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.176135 Nov 02 12:55:40.678350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 250/478] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:40 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:41.705077 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:41.706040 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:41.716802 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:41.717561 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:41.718856 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:41.719660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:41.868519 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:41.876784 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8b0d9cf9-40b2-489c-b9a9-1f9decd000ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.178566 Nov 02 12:55:41.877347 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 229/479] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:41 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:42.909436 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:42.910040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:42.916950 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:42.917425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:42.918189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:42.918617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:43.074273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:43.081909 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d92beaa2-903a-47e3-9ccb-67a94864af12 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1510 microversion: 2.1 time: 0.176544 Nov 02 12:55:43.082485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 251/480] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:42 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:44.117976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:44.118609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:44.125278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:44.126237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:44.127796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:44.128328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:44.341099 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:44.350145 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8442b3b2-0c78-42e1-9796-0575a79ec651 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1516 microversion: 2.1 time: 0.237072 Nov 02 12:55:44.350828 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 230/481] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:44 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:46.880862 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e87e7dce-8ffc-4bba-9c4e-169a19db60fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'create', calling method: .version_select at 0x7fbe43b0a9d0>, body: {"keypair": {"name": "tempest-keypair-1576174273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsy64V1xEx2sTfwzY6RttshKN4/CCAmi5CyAqxNTO9M4E/YYZ4gtm8Q2XPSql3pSd6uU3rjwnVLcd0NyA5t7ffm5GMPlQxfUyVBajPgBxY6EEGSR5eGrAjCw9qRFuCgtA=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:46.896051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-e87e7dce-8ffc-4bba-9c4e-169a19db60fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:55:46.899924 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-e87e7dce-8ffc-4bba-9c4e-169a19db60fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for user 12d35ac129c24e118df9ebee0c8c9f6f and project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:55:46.911816 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e87e7dce-8ffc-4bba-9c4e-169a19db60fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [492d1a16-92bf-4874-9a92-98f1cec77b2b] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:55:47.920378 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [None req-e87e7dce-8ffc-4bba-9c4e-169a19db60fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [492d1a16-92bf-4874-9a92-98f1cec77b2b] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 59392. Nov 02 12:55:47.953215 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e87e7dce-8ffc-4bba-9c4e-169a19db60fc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.076466 Nov 02 12:55:47.953813 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 252/482] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 12:55:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:55:49.879740 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-755419746", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44813eaf-ef4c-426e-8812-9534d97c5b8a"}], "security_groups": [{"name": "tempest-securitygroup--1747584344"}], "key_name": "tempest-keypair-1576174273", "user_data": "}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:56.066338 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5143caef-80ef-412d-84e8-2ea46fc85b73 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "294bd144-f0f2-4362-ac84-dfa697d8f21b", "device": "/dev/sdb"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:56.068078 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5143caef-80ef-412d-84e8-2ea46fc85b73 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:56.074495 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5143caef-80ef-412d-84e8-2ea46fc85b73 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:56.074947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5143caef-80ef-412d-84e8-2ea46fc85b73 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:56.075743 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5143caef-80ef-412d-84e8-2ea46fc85b73 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:56.076190 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5143caef-80ef-412d-84e8-2ea46fc85b73 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:56.420175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5143caef-80ef-412d-84e8-2ea46fc85b73 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "POST /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357710 Nov 02 12:55:56.421048 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 253/483] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 12:55:56 2022] POST /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:55:56.426886 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-888010978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2037140484", "security_groups": [{"name": "tempest-secgroup-smoke-994655925"}], "block_device_mapping_v2": [{"uuid": "fb8a193a-9472-4df5-85d1-153f91a74dcc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dc24f821-79ec-4404-92fe-d5786cb39ed4"}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:56.575134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] validate_networks() for [('dc24f821-79ec-4404-92fe-d5786cb39ed4', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:55:57.152099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:55:57.152775 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:55:57.153319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:55:57.153842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:55:57.154197 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:55:57.165051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:57.165505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:57.166366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:57.166829 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:57.187177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:55:57.192135 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for user 8c01ed6e76ef4ee4ba5356c526e113e4 and project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:55:57.257622 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:55:57.260234 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb8a193a-9472-4df5-85d1-153f91a74dcc',volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:55:57.410741 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [a4fbea9d-937b-432c-9ab4-15e472fd9d5b] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:55:58.419878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [a4fbea9d-937b-432c-9ab4-15e472fd9d5b] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 59520. Nov 02 12:55:58.435530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ebb8880a-635b-48d9-b462-41bd3ebfd096 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.012776 Nov 02 12:55:58.443300 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 254/484] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:55:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:55:58.464557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-619a0a85-56da-4f8f-8fd5-27ec2992cdb7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:58.465515 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-619a0a85-56da-4f8f-8fd5-27ec2992cdb7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:58.544959 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-619a0a85-56da-4f8f-8fd5-27ec2992cdb7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:58.553597 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-619a0a85-56da-4f8f-8fd5-27ec2992cdb7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1094 microversion: 2.1 time: 0.100437 Nov 02 12:55:58.571478 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 255/485] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:58 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1094 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:59.580525 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:59.582004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:55:59.590441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:59.591221 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:59.592285 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:55:59.593061 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:55:59.695551 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:59.705267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1553076e-240e-46d6-ac77-56f4ed602f35 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1192 microversion: 2.1 time: 0.128899 Nov 02 12:55:59.706072 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 256/486] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:59 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:00.748868 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:00.749566 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:00.756303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:00.756839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:00.758040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:00.758564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:00.975544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:00.987959 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f72e7cbc-efd8-4be0-a4d2-daaea31b5a9a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1277 microversion: 2.1 time: 0.254946 Nov 02 12:56:01.001961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 257/487] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:00 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:01.226351 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] validate_networks() for [('44813eaf-ef4c-426e-8812-9534d97c5b8a', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:56:01.887999 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:56:01.888610 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:56:01.889153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:56:01.889593 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:56:01.890063 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:56:01.900942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:01.901408 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:01.902282 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:01.903465 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:01.907341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-fe220bd0-c003-4e7f-a520-8a3cb6b85076 req-5fc10f61-19e3-451e-85b8-57ff814300f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88552fef-2b2e-4ddf-bde5-ef27eeb43214", "tag": "38d92677-8f89-4c4b-a02f-8a041e0b5b53"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:01.926663 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:56:01.931093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-fe220bd0-c003-4e7f-a520-8a3cb6b85076 req-5fc10f61-19e3-451e-85b8-57ff814300f7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:01.931424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Getting quotas for user 12d35ac129c24e118df9ebee0c8c9f6f and project 9d086a8e68a94153b5d2a15d6d54fc63. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:56:01.936449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-fe220bd0-c003-4e7f-a520-8a3cb6b85076 req-5fc10f61-19e3-451e-85b8-57ff814300f7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:01.944233 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:56:01.946861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:56:01.967412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-fe220bd0-c003-4e7f-a520-8a3cb6b85076 req-5fc10f61-19e3-451e-85b8-57ff814300f7 service nova] Creating event network-changed:38d92677-8f89-4c4b-a02f-8a041e0b5b53 for instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 on hv-cinder-86327 Nov 02 12:56:01.981319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-fe220bd0-c003-4e7f-a520-8a3cb6b85076 req-5fc10f61-19e3-451e-85b8-57ff814300f7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077937 Nov 02 12:56:01.984097 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 258/488] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:56:02.018723 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-54d7bcf1-0bea-4c32-b884-0a10d873b4d8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.144035 Nov 02 12:56:02.018905 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:02.019424 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:02.019724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 231/489] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:55:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 12146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:56:02.034409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:02.034651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d0ce6840-4a1f-48c4-8cd7-2130f4e151e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:02.035450 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d0ce6840-4a1f-48c4-8cd7-2130f4e151e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:02.036049 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:02.037282 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:02.037974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:02.165302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d0ce6840-4a1f-48c4-8cd7-2130f4e151e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:02.181415 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d0ce6840-4a1f-48c4-8cd7-2130f4e151e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1245 microversion: 2.1 time: 0.153037 Nov 02 12:56:02.182322 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 232/490] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:02 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1245 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:02.216661 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:02.227664 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-78ae95b2-207d-4fb5-9581-8c336c0a1da0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1277 microversion: 2.1 time: 0.213732 Nov 02 12:56:02.228267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 259/491] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:02 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:03.205575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:03.206146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:03.213120 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:03.213577 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:03.214392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:03.214828 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:03.255181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:03.255919 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:03.263193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:03.263645 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:03.264473 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:03.264912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:03.284728 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:03.293872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-96e837c0-3e39-4a24-bc36-daa523a1e8b1 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1297 microversion: 2.1 time: 0.092473 Nov 02 12:56:03.302368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 233/492] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:03 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:03.409376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:03.417888 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-72166cb9-b66e-4797-a308-c57155ee8490 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1277 microversion: 2.1 time: 0.166593 Nov 02 12:56:03.428278 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 260/493] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:03 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:04.317459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:04.318061 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:04.324821 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:04.325496 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:04.326271 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:04.326890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:04.441744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:04.442385 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:04.448917 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:04.449364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:04.450131 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:04.450562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:04.612872 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:04.614118 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:04.622944 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6b803f95-30fd-4578-a352-b10192074e9c tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.309712 Nov 02 12:56:04.630533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 234/494] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:04 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:04.630732 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-584ea079-4eda-410f-a5f4-08bcbb241386 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1277 microversion: 2.1 time: 0.188970 Nov 02 12:56:04.631073 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 261/495] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:04 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:04.946169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d0a312ac-9d29-4908-a611-649c719be7c2 req-25bd88e9-6577-47e1-b7d3-21eaef6a6495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddf14ef-eff5-4de1-b925-5be7a93bd241", "tag": "ae508632-412e-4df0-bb2e-e258d1a95cfa"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:04.973683 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d0a312ac-9d29-4908-a611-649c719be7c2 req-25bd88e9-6577-47e1-b7d3-21eaef6a6495 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:04.974409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d0a312ac-9d29-4908-a611-649c719be7c2 req-25bd88e9-6577-47e1-b7d3-21eaef6a6495 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:04.989641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d0a312ac-9d29-4908-a611-649c719be7c2 req-25bd88e9-6577-47e1-b7d3-21eaef6a6495 service nova] Creating event network-changed:ae508632-412e-4df0-bb2e-e258d1a95cfa for instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 on hv-cinder-86327 Nov 02 12:56:04.995896 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d0a312ac-9d29-4908-a611-649c719be7c2 req-25bd88e9-6577-47e1-b7d3-21eaef6a6495 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067998 Nov 02 12:56:04.996568 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 235/496] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:05.647943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:05.648621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:05.656658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:05.657122 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:05.658609 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:05.659038 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:05.660445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:05.661159 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:05.668677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:05.669108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:05.670101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:05.670514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:05.812462 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:05.821041 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-307dad9a-4b3e-40fc-80c9-ba3ba70b4a48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.177533 Nov 02 12:56:05.821685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 262/497] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:05 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:05.925602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:05.934726 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6f3785ae-5a23-4c0a-97a9-03cb3dbb618b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.278899 Nov 02 12:56:05.936264 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 236/498] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:05 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:06.845014 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:06.845630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:06.852546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:06.852999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:06.853740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:06.854172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:06.960253 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:06.961070 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:06.968114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:06.968597 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:06.969439 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:06.969876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:06.996713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:07.004905 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-20b94d06-e4bb-4a00-8634-c17f913b519a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.163616 Nov 02 12:56:07.005483 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 263/499] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:06 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:07.114824 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:07.126875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0db29fe4-89ce-407f-9af1-98fe9594ff14 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.171273 Nov 02 12:56:07.127485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 237/500] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:06 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:08.030745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:08.031462 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:08.040412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:08.040973 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:08.041927 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:08.042465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:08.155692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:08.156312 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:08.163276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:08.163733 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:08.164581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:08.164991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:08.190034 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:08.197983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-37704925-d9f4-4b0a-aca7-74af87106d5a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.172157 Nov 02 12:56:08.198575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 264/501] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:08 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:08.311255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:08.319747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-37713090-0d99-45fc-aa24-e87589ca942b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.167914 Nov 02 12:56:08.320340 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 238/502] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:08 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:09.225843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:09.226843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:09.237683 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:09.238161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:09.239006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:09.239478 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:09.342905 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:09.343642 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:09.350617 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:09.351146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:09.352003 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:09.352505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:09.385127 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:09.393202 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a100b292-a045-4000-9512-711ed4a96f9b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.173875 Nov 02 12:56:09.404493 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 265/503] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:09 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:09.498342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:09.508425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1df83d70-18d4-466b-9a5c-f9a186adb24e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.169004 Nov 02 12:56:09.509353 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 239/504] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:09 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:10.421373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:10.422529 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:10.433572 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:10.434306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:10.435563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:10.436259 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:10.537873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:10.538445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:10.544950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:10.545400 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:10.546267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:10.546762 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:10.596271 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:10.604142 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-20e45cc7-21f0-4deb-8cee-d16c2323642e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.189354 Nov 02 12:56:10.604749 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 266/505] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:10 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:10.697365 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:10.705745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-009769ff-e93b-4163-9577-464bf466d991 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.173551 Nov 02 12:56:10.706361 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 240/506] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:10 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:11.627011 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:11.627630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:11.634748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:11.635201 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:11.635979 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:11.636522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:11.730908 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:11.731660 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:11.738788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:11.739340 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:11.740133 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:11.740688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:11.773532 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:11.781062 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-04dc1df9-df7b-48a2-9c3a-93028b9a9c95 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.157942 Nov 02 12:56:11.781677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 267/507] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:11 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:11.886440 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:11.894502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b1222467-6c93-4303-ae33-ccd940aeb69b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.167714 Nov 02 12:56:11.895528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 241/508] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:11 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:12.809237 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:12.810242 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:12.819790 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:12.820306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:12.821046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:12.821481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:12.918004 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:12.918573 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:12.925556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:12.926094 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:12.927096 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:12.927528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:12.963579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:12.971599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-79bbd0e3-6f6c-418e-94f1-147d5270de0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.168939 Nov 02 12:56:12.972186 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 268/509] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:12 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:13.067402 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:13.075939 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9a0f4b28-6e57-412f-abd5-a6b4a0c1c894 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.161939 Nov 02 12:56:13.076566 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 242/510] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:12 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:14.000346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:14.000981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:14.007518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:14.007967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:14.008770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:14.009201 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:14.101743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:14.102420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:14.115289 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:14.115844 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:14.116790 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:14.117404 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:14.156504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:14.167566 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d33e0ead-9d11-403e-ad89-b095cad83025 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.174658 Nov 02 12:56:14.168223 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 269/511] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:13 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:14.354429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:14.362090 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ba6b4ebf-d297-4752-b016-956d1a025237 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.264506 Nov 02 12:56:14.362672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 243/512] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:14 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:15.191130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:15.191703 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:15.198729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:15.199183 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:15.199942 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:15.200425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:15.341573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:15.352273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d6ec9d1b-13f3-4bab-a8f8-2d9413554b47 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.164866 Nov 02 12:56:15.353057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 270/513] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:15 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:15.392132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:15.393177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:15.400049 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:15.400511 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:15.401277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:15.401705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:15.546337 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:15.554962 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-52a3df2d-2901-4a77-9ff9-56e82b6105d3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.168288 Nov 02 12:56:15.555572 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 244/514] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:15 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:16.379268 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:16.380001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:16.387056 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:16.387513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:16.388372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:16.388796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:16.524583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:16.532814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cf958296-aaef-4851-b4ef-ba7103c8ccdf tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.157491 Nov 02 12:56:16.533370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 271/515] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:16 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:16.579263 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:16.580010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:16.587420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:16.587994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:16.588844 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:16.589300 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:16.779604 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:16.787841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-435cfaf6-1b09-4265-9c87-2a7ff6e7899e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.212749 Nov 02 12:56:16.788564 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 245/516] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:16 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:17.562328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:17.562937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:17.570090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:17.570522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:17.571295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:17.571724 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:17.713189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:17.720992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5e270dc5-0608-487a-9def-c3e003292204 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.164670 Nov 02 12:56:17.721591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 272/517] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:17 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:17.811195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:17.811807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:17.818558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:17.819017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:17.819791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:17.820248 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:17.963712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:17.971608 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-49feb9ec-9e04-46bc-a83c-f1c222dd7644 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.164383 Nov 02 12:56:17.972055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 246/518] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:17 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:18.746795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:18.747508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:18.755351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:18.756006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:18.756946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:18.757455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:18.899126 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:18.909172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-625992b9-2240-4de1-88ab-3ac9ba7feec6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.166780 Nov 02 12:56:18.909890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 273/519] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:18 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:18.996334 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:18.997198 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:19.005391 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:19.005914 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:19.006811 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:19.007310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:19.159106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:19.170050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ba723b22-673a-4ac5-97b2-ee4d0e32f51c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.178118 Nov 02 12:56:19.170790 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 247/520] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:18 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:19.943265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:19.944332 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:19.955498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:19.956262 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:19.957537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:19.958315 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:20.096873 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:20.104726 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e300a5d3-56f2-4620-a28d-296e0bfb295e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.167915 Nov 02 12:56:20.105327 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 274/521] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:19 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:20.196053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:20.196638 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:20.204322 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:20.204818 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:20.205683 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:20.206164 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:20.359285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:20.367633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cbbada7d-9cb0-4448-b1f0-4e48b8088c3c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.177392 Nov 02 12:56:20.368176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 248/522] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:20 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:21.129849 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:21.130616 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:21.139554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:21.140148 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:21.141307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:21.141882 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:21.281781 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:21.292775 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2094050f-a70d-47bd-8b86-9ddddf6c1b41 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.167805 Nov 02 12:56:21.293504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 275/523] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:21 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:21.390926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:21.391543 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:21.399715 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:21.400189 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:21.400972 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:21.401404 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:21.545109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:21.554515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e55824d6-7ca8-4823-a4c0-716cdd1d3304 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.167525 Nov 02 12:56:21.555114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 249/524] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:21 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:22.322244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:22.322838 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:22.329267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:22.329712 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:22.330463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:22.330890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:22.469051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:22.478680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1021c888-546d-4601-a0df-4d565fb6346f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.162356 Nov 02 12:56:22.479277 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 276/525] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:22 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:22.577991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:22.578578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:22.585612 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:22.586056 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:22.586811 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:22.587237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:22.730046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:22.738185 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c540adf3-37b3-42bc-babf-a83d023d0fa9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.164193 Nov 02 12:56:22.738753 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 250/526] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:22 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:23.501008 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:23.501593 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:23.508375 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:23.508794 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:23.509594 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:23.510055 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:23.651322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:23.659292 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aebdcec9-cef0-4316-a4c4-8790b6977b8e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.162181 Nov 02 12:56:23.660000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 277/527] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:23 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:23.763659 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:23.764614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:23.774797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:23.775406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:23.776585 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:23.777156 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:23.931456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:23.939149 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0871266c-192e-4009-855e-22c90d48e03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.181564 Nov 02 12:56:23.939717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 251/528] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:23 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:24.682355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:24.683063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:24.689738 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:24.690189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:24.690956 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:24.691581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:24.833006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:24.843950 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-61bdeee1-e76e-4749-a196-c10bee3ce0ed tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.165450 Nov 02 12:56:24.844798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 278/529] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:24 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:24.966186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:24.966862 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:24.975724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:24.976333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:24.977280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:24.977854 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:25.135542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:25.145193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b2f77760-b78c-4e65-a66b-617efa5afbe8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.184097 Nov 02 12:56:25.145817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 252/530] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:24 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:25.870780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:25.871396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:25.878057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:25.878515 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:25.879278 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:25.879708 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:26.032927 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:26.041004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5a04fac1-098e-4b24-bf28-bb0f4498b096 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.174609 Nov 02 12:56:26.041625 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 279/531] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:25 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:26.169088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:26.169675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:26.176384 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:26.176841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:26.177630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:26.178044 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:26.324622 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:26.332870 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b8ad38a8-af92-4a23-93ca-b5c8caa559a9 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.167727 Nov 02 12:56:26.333446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 253/532] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:26 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:27.069319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:27.070176 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:27.077320 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:27.077766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:27.078528 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:27.078958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:27.243262 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:27.251095 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-566a4274-c4cd-4ecf-8dce-a57edc37dd4a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.188752 Nov 02 12:56:27.251673 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 280/533] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:27 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:27.360885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:27.361743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:27.371104 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:27.371556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:27.372356 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:27.372786 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:27.523948 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:27.531756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c8eb070e-ac61-4e4e-88f1-90be139a9169 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.177574 Nov 02 12:56:27.532382 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 254/534] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:27 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:28.286641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:28.288618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:28.295657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:28.296111 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:28.296963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:28.297399 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:28.455065 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:28.464787 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2ac33a0d-128c-4adb-b5da-58848a0310c3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.183804 Nov 02 12:56:28.465666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 281/535] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:28 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:28.557858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:28.558689 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:28.568018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:28.568673 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:28.569713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:28.570612 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:28.725756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:28.739571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-77714b71-7546-48c0-b578-e26f60833acd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.186605 Nov 02 12:56:28.740383 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 255/536] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:28 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:29.490984 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:29.491608 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:29.499657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:29.500116 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:29.500913 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:29.501344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:29.655142 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:29.663695 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-056a42c0-0280-4e89-9102-d2b5c8973d70 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.178411 Nov 02 12:56:29.664654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 282/537] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:29 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:29.764807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:29.765385 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:29.772780 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:29.773222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:29.773987 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:29.774419 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:29.927150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:29.935540 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-be700dab-cf46-42bb-8767-7373e89c5a20 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.174719 Nov 02 12:56:29.936110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 256/538] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:29 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:30.692907 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:30.693808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:30.703253 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:30.703859 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:30.704974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:30.705622 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:30.842974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:30.850905 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e6708061-7549-449d-8508-ce5b7f6cd657 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.163418 Nov 02 12:56:30.851871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 283/539] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:30 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:30.961493 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:30.962325 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:30.971691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:30.972261 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:30.973450 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:30.974057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:31.136067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:31.143752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fad0a48e-a92c-47d7-a1f6-43b0afe964cc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.187833 Nov 02 12:56:31.144336 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 257/540] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:30 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:31.875652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:31.876396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:31.883812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:31.884468 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:31.885251 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:31.885684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:32.030199 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:32.037957 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c82a9466-9d4c-4d86-8397-2bb805b907e9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.166624 Nov 02 12:56:32.038546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 284/541] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:31 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:32.166928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:32.167668 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:32.174113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:32.174642 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:32.175491 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:32.175996 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:32.324782 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:32.332483 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ce363da4-1b1d-4ed3-86bc-820c59a46c44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.169329 Nov 02 12:56:32.333075 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 258/542] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:32 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:33.061703 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:33.062482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:33.072874 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:33.073627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:33.074449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:33.075035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:33.243831 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:33.252561 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ad914c4b-f38e-4ea1-952f-f2051c5af3ac tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.194670 Nov 02 12:56:33.269240 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 285/543] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:33 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:33.356442 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:33.357065 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:33.363381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:33.363841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:33.364666 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:33.365099 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:33.515557 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:33.523976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-39d0904a-ae06-4edd-a1dd-0fd93c299228 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.171495 Nov 02 12:56:33.524758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 259/544] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:33 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:34.278019 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:34.279252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:34.285451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:34.286038 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:34.286818 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:34.287491 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:34.428498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:34.436260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-de171069-836f-4386-90bc-351b5d112f61 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.162814 Nov 02 12:56:34.436827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 286/545] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:34 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:34.547492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:34.548138 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:34.555286 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:34.555741 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:34.556671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:34.557108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:34.711924 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:34.719865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b943102c-fbc2-4c75-9e08-70a2a5918094 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.176445 Nov 02 12:56:34.720519 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 260/546] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:34 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:34.978996 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:34.979492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:34.986389 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:34.986840 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:34.987624 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:34.988153 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:35.121112 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lazy-loading 'services' on Instance uuid f561ba4f-0814-475b-8ad1-5e79cfe5b851 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:56:35.246685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4fb99c68-03e9-4042-955e-b3b93e679b59 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851/os-volume_attachments/294bd144-f0f2-4362-ac84-dfa697d8f21b" status: 202 len: 0 microversion: 2.1 time: 0.271761 Nov 02 12:56:35.247276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 287/547] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 12:56:34 2022] DELETE /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851/os-volume_attachments/294bd144-f0f2-4362-ac84-dfa697d8f21b => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:56:35.460747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:35.461272 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:35.467883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:35.468369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:35.469161 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:35.469630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:35.614023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:35.621654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-36d4b22d-c5c0-4867-b8b9-a1427366de9a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.165020 Nov 02 12:56:35.622196 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 261/548] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:35 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:35.744643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:35.745193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:35.755630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:35.756099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:35.756919 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:35.757357 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:35.901049 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:35.909068 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f64179ec-61d0-42ae-aa9e-8520750a5e11 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.169401 Nov 02 12:56:35.909651 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 288/549] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:35 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:36.648565 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:36.649216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:36.657476 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:36.657928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:36.658699 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:36.659137 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:36.816504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:36.824568 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-17675b6e-a290-47d3-af31-797f63492120 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.182697 Nov 02 12:56:36.825205 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 262/550] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:36 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:36.936116 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:36.936865 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:36.946783 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:36.947448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:36.948871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:36.949488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:37.090795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:37.098628 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f4001d5c-e68b-4f15-b4b4-970376ca4c69 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.168776 Nov 02 12:56:37.099194 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 289/551] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:36 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:37.662669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-3d9a1150-1f5a-43af-93a6-a6687d7774fb req-6b83556f-ee4e-4fb3-ad80-0353b826faeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88552fef-2b2e-4ddf-bde5-ef27eeb43214", "name": "network-vif-plugged", "status": "completed", "tag": "38d92677-8f89-4c4b-a02f-8a041e0b5b53"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:37.672909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-3d9a1150-1f5a-43af-93a6-a6687d7774fb req-6b83556f-ee4e-4fb3-ad80-0353b826faeb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:37.673395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-3d9a1150-1f5a-43af-93a6-a6687d7774fb req-6b83556f-ee4e-4fb3-ad80-0353b826faeb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:37.685295 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-3d9a1150-1f5a-43af-93a6-a6687d7774fb req-6b83556f-ee4e-4fb3-ad80-0353b826faeb service nova] Creating event network-vif-plugged:38d92677-8f89-4c4b-a02f-8a041e0b5b53 for instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 on hv-cinder-86327 Nov 02 12:56:37.690452 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-3d9a1150-1f5a-43af-93a6-a6687d7774fb req-6b83556f-ee4e-4fb3-ad80-0353b826faeb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Nov 02 12:56:37.691328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 263/552] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:37.847570 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:37.848284 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:37.854681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:37.855131 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:37.855908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:37.856425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:38.008972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:38.016975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2aa6002f-acbe-4acc-a661-8d1160ca3519 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.173380 Nov 02 12:56:38.018040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 290/553] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:37 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:38.122777 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:38.123564 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:38.130161 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:38.130619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:38.131406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:38.131839 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:38.281809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:38.293556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e497fa48-bfb5-4654-936d-600fe55c6f7e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.175193 Nov 02 12:56:38.294462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 264/554] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:38 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:39.045307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:39.045985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:39.055200 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:39.055842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:39.056999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:39.057585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:39.209250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:39.217646 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e2aac328-ddd1-41e5-9074-93f16b6f79e5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.178777 Nov 02 12:56:39.218186 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 291/555] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:39 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:39.321648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:39.322193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:39.330479 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:39.330928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:39.331693 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:39.332335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:39.486333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:39.494124 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8776b474-1ec9-40af-854b-9d63a6208146 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.179362 Nov 02 12:56:39.494725 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 265/556] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:39 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:39.715228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-1fb37598-be9a-407e-a304-3d653fe05c72 req-219fd631-ed12-4694-b237-2257907ee64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddf14ef-eff5-4de1-b925-5be7a93bd241", "name": "network-vif-plugged", "status": "completed", "tag": "ae508632-412e-4df0-bb2e-e258d1a95cfa"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:39.726828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-1fb37598-be9a-407e-a304-3d653fe05c72 req-219fd631-ed12-4694-b237-2257907ee64c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:39.727405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-1fb37598-be9a-407e-a304-3d653fe05c72 req-219fd631-ed12-4694-b237-2257907ee64c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:39.740144 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-1fb37598-be9a-407e-a304-3d653fe05c72 req-219fd631-ed12-4694-b237-2257907ee64c service nova] Creating event network-vif-plugged:ae508632-412e-4df0-bb2e-e258d1a95cfa for instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 on hv-cinder-86327 Nov 02 12:56:39.745406 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-1fb37598-be9a-407e-a304-3d653fe05c72 req-219fd631-ed12-4694-b237-2257907ee64c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035260 Nov 02 12:56:39.745961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 292/557] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:40.242761 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:40.243402 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:40.250429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:40.250885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:40.251843 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:40.252093 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:40.396788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:40.404584 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-86c304ec-a208-4b98-8931-a21c5b5bb336 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.166114 Nov 02 12:56:40.405214 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 266/558] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:40 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:40.519526 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:40.520087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:40.526908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:40.527372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:40.528157 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:40.528635 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:40.691063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:40.699145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8f0b2aae-ac1f-4e6d-9708-9c4724416c4f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.185137 Nov 02 12:56:40.699730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 293/559] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:40 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:41.427707 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:41.428395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:41.435478 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:41.435929 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:41.436736 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:41.437180 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:41.583278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:41.590902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d58e1832-4b64-49e7-916d-2bb21cc6c4fb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.167237 Nov 02 12:56:41.591461 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 267/560] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:41 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:41.723681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:41.723681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:41.729985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:41.730699 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:41.731479 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:41.731918 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:41.877334 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:41.886554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4021f5d1-1236-44a9-ba9c-f39d0414bb83 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.168280 Nov 02 12:56:41.887955 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 294/561] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:41 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:42.615495 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:42.616195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:42.622877 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:42.623327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:42.624135 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:42.624590 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:42.768976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:42.776735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8c4ef1d4-43ac-4478-bbce-915ebe901b0f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.165582 Nov 02 12:56:42.792473 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 268/562] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:42 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:42.911878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:42.912671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:42.919818 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:42.920477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:42.921565 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:42.922157 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:43.067298 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:43.077417 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-007dae7f-ceb7-4eeb-8d97-3e64ffbc172e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.170166 Nov 02 12:56:43.078062 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 295/563] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:42 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:43.802118 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:43.803147 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:43.811562 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:43.812153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:43.813092 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:43.813571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:43.861334 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:43.861832 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:43.868126 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:43.868670 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:43.869444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:43.869876 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:43.895392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 12:56:43.959021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:43.967170 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2e5b67c0-0b4f-4804-b969-8634819f5288 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.169964 Nov 02 12:56:43.980851 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 269/564] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:43 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:43.994889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9d7b4d09-6d1f-4f19-92d8-75c8c9bb54d1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 204 len: 0 microversion: 2.1 time: 0.137205 Nov 02 12:56:43.995509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 296/565] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 12:56:43 2022] DELETE /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:56:44.004581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:44.005194 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:44.011408 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:44.011858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:44.012669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:44.013100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:44.101729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:44.102425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:44.109331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:44.109768 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:44.110539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:44.110966 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:44.153001 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:44.160790 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-74325b27-5015-46a9-8d54-4ffdd47be3bb tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1513 microversion: 2.1 time: 0.160609 Nov 02 12:56:44.161348 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 270/566] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:43 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:44.251746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:44.260657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cbe71373-9c56-4864-a6b8-92f19a4fd076 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.162996 Nov 02 12:56:44.261496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 297/567] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:44 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:44.991229 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:44.991889 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:44.998973 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:44.999424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:45.000178 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:45.000813 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:45.145021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.155890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5bd07967-43d7-4b5e-909d-c3b1250a8494 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.168373 Nov 02 12:56:45.156636 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 271/568] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:44 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:45.186759 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:45.187390 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:45.195132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:45.195582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:45.196509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:45.196951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:45.291427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:45.292044 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:45.298390 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:45.298844 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:45.299758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:45.300194 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:45.340060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.347770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-43fc7873-b985-4c96-afe8-23b894457a32 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1513 microversion: 2.1 time: 0.167019 Nov 02 12:56:45.348392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 298/569] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:45 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:45.439842 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:45.447628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c441cdb9-1126-4962-8656-8809cd3ae6f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.160240 Nov 02 12:56:45.448195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 272/570] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:45 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:46.180528 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:46.181138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:46.187663 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:46.188260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:46.188951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:46.189412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:46.335754 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:46.344163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c1f3c568-eed0-44ad-9696-bcb4f590e96d tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.167713 Nov 02 12:56:46.344776 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 299/571] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:46 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:46.371273 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:46.371877 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:46.378483 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:46.379079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:46.379848 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:46.380295 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:46.471037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:46.471763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:46.477960 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:46.478475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:46.479265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:46.479709 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:46.532685 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:46.540499 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-105a56e8-923d-4b60-9d04-79c4faee6f9a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1513 microversion: 2.1 time: 0.173162 Nov 02 12:56:46.541073 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 273/572] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:46 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:46.616598 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:46.624814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-720109e9-7696-4013-a60a-7942e979435a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.157781 Nov 02 12:56:46.625380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 300/573] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:46 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:47.367943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:47.368678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:47.375712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:47.376327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:47.376945 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:47.377388 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:47.526222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:47.533909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6e9a8fa3-9c24-4f42-a52b-0b3b3dae454f tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.170023 Nov 02 12:56:47.534618 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 274/574] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:47 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:47.564444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:47.564982 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:47.572132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:47.572676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:47.573465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:47.573910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:47.648824 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:47.649439 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:47.655389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:47.655832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:47.656633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:47.657061 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:47.716742 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:47.724565 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b072c9b3-6209-4d3f-a770-f12d9d4d4f1c tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1513 microversion: 2.1 time: 0.164377 Nov 02 12:56:47.725163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 301/575] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:47 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:47.797657 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:47.806093 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-61051952-1587-4cc7-8a38-a23ffe6b4fee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.161454 Nov 02 12:56:47.806662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 275/576] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:47 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:48.564612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:48.565511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:48.576611 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:48.577365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:48.578637 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:48.579320 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:48.718162 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:48.727597 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-19adad2f-42b1-4e51-b4ce-036edc5539b5 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1371 microversion: 2.1 time: 0.170954 Nov 02 12:56:48.728216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 302/577] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:48 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:48.748263 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:48.748889 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:48.755811 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:48.756283 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:48.757099 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:48.757528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:48.829042 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:48.829589 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:48.836035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:48.836526 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:48.837300 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:48.837737 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:48.904035 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:48.912149 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5971f2bd-e734-4895-88fe-d0a6ff679fe9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1513 microversion: 2.1 time: 0.167921 Nov 02 12:56:48.912802 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 276/578] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:48 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:48.976712 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:48.988191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3fca90a4-9e6e-4c6f-833e-a27f51152e51 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1265 microversion: 2.1 time: 0.163270 Nov 02 12:56:48.988791 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 303/579] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:48 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:49.751446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:49.752031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:49.759205 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:49.759663 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:49.760476 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:49.760942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:49.911000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:49.919404 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-02444ef3-a51d-4846-ba37-28966a46e55b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1565 microversion: 2.1 time: 0.172104 Nov 02 12:56:49.919960 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 277/580] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:49 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:49.935250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:49.935846 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:49.942564 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-63b2d4b9-5bdf-4263-8b76-57e9c8b05a89 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:49.942912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:49.943061 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-63b2d4b9-5bdf-4263-8b76-57e9c8b05a89 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:49.943355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:49.944138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:49.944712 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:49.949285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63b2d4b9-5bdf-4263-8b76-57e9c8b05a89 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:49.949740 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63b2d4b9-5bdf-4263-8b76-57e9c8b05a89 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:49.950515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63b2d4b9-5bdf-4263-8b76-57e9c8b05a89 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:49.950953 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63b2d4b9-5bdf-4263-8b76-57e9c8b05a89 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:50.037167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-63b2d4b9-5bdf-4263-8b76-57e9c8b05a89 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098395 Nov 02 12:56:50.037758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 278/581] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 12:56:49 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:50.042166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:50.042967 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:50.051883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:50.052487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:50.053347 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:50.053986 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:50.085538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:50.094538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0e899a36-fb81-4648-a96e-bbfb261f7f5a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1513 microversion: 2.1 time: 0.163391 Nov 02 12:56:50.095258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 304/582] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:49 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:50.346245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:50.354602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6aaa3ace-c9a0-477e-b2bd-06599db6c11e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1452 microversion: 2.1 time: 0.315486 Nov 02 12:56:50.355217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 279/583] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:50 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1452 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:50.377791 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:50.378469 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:50.384790 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:50.385244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:50.386059 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:50.386496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:50.528966 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:50.537218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d4a120ad-2649-462a-820e-b6d02c3cb522 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1452 microversion: 2.1 time: 0.163305 Nov 02 12:56:50.537863 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 305/584] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:50 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:51.117680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:51.118446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:51.125815 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:51.126352 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:51.127304 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:51.127795 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:51.388319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-8c63ce42-8a88-4cee-8534-f0d83c90f9a5 req-0be8fb1e-b701-4e90-a092-5525915ea05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddf14ef-eff5-4de1-b925-5be7a93bd241", "tag": "ae508632-412e-4df0-bb2e-e258d1a95cfa"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:51.399689 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-8c63ce42-8a88-4cee-8534-f0d83c90f9a5 req-0be8fb1e-b701-4e90-a092-5525915ea05d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:51.399910 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:51.400686 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-8c63ce42-8a88-4cee-8534-f0d83c90f9a5 req-0be8fb1e-b701-4e90-a092-5525915ea05d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:51.409580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-669d01f5-54a4-405a-8b0c-810f98b21cfe tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1513 microversion: 2.1 time: 0.295874 Nov 02 12:56:51.411493 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 280/585] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:51 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:51.417478 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-8c63ce42-8a88-4cee-8534-f0d83c90f9a5 req-0be8fb1e-b701-4e90-a092-5525915ea05d service nova] Creating event network-changed:ae508632-412e-4df0-bb2e-e258d1a95cfa for instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 on hv-cinder-86327 Nov 02 12:56:51.423665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-8c63ce42-8a88-4cee-8534-f0d83c90f9a5 req-0be8fb1e-b701-4e90-a092-5525915ea05d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040014 Nov 02 12:56:51.427928 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 306/586] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:56:52.436174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:52.436983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:52.444082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:52.444724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:52.445776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:52.446293 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:52.582300 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:52.603640 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f9ac9f61-849b-4c30-b048-30b7411ba86d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1471 microversion: 2.1 time: 0.173629 Nov 02 12:56:52.609349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 281/587] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:52 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:52.703637 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-4da10fa6-eb1a-4489-9dfd-611ec9bb407a req-0f00a01b-f02e-4211-bdc9-d336beb57934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88552fef-2b2e-4ddf-bde5-ef27eeb43214", "tag": "38d92677-8f89-4c4b-a02f-8a041e0b5b53"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:52.713445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-4da10fa6-eb1a-4489-9dfd-611ec9bb407a req-0f00a01b-f02e-4211-bdc9-d336beb57934 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:52.713807 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-4da10fa6-eb1a-4489-9dfd-611ec9bb407a req-0f00a01b-f02e-4211-bdc9-d336beb57934 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:52.725977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-4da10fa6-eb1a-4489-9dfd-611ec9bb407a req-0f00a01b-f02e-4211-bdc9-d336beb57934 service nova] Creating event network-changed:38d92677-8f89-4c4b-a02f-8a041e0b5b53 for instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 on hv-cinder-86327 Nov 02 12:56:52.732311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-4da10fa6-eb1a-4489-9dfd-611ec9bb407a req-0f00a01b-f02e-4211-bdc9-d336beb57934 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Nov 02 12:56:52.733771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 307/588] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:53.441517 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-009c02cb-723a-403e-bb65-970c05774417 req-df5add2c-d4d5-4986-86d2-5ff05bf9affc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f561ba4f-0814-475b-8ad1-5e79cfe5b851", "name": "network-vif-deleted", "tag": "f9228980-d82d-4aaa-a38d-0af21963a57f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:53.459676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-009c02cb-723a-403e-bb65-970c05774417 req-df5add2c-d4d5-4986-86d2-5ff05bf9affc service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:53.460126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-009c02cb-723a-403e-bb65-970c05774417 req-df5add2c-d4d5-4986-86d2-5ff05bf9affc service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:53.472323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-009c02cb-723a-403e-bb65-970c05774417 req-df5add2c-d4d5-4986-86d2-5ff05bf9affc service nova] Creating event network-vif-deleted:f9228980-d82d-4aaa-a38d-0af21963a57f for instance f561ba4f-0814-475b-8ad1-5e79cfe5b851 on hv-cinder-86327 Nov 02 12:56:53.477524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-009c02cb-723a-403e-bb65-970c05774417 req-df5add2c-d4d5-4986-86d2-5ff05bf9affc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040045 Nov 02 12:56:53.478113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 282/589] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:56:53.634721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:53.635455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:53.641717 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:53.642681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:53.643780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:53.644495 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:53.679505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:53.680319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:53.681033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lazy-loading 'fault' on Instance uuid f561ba4f-0814-475b-8ad1-5e79cfe5b851 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:56:53.726697 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:53.745837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d1b30fd6-6328-4193-9427-955adb878f2f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 200 len: 1308 microversion: 2.1 time: 0.115109 Nov 02 12:56:53.746594 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 308/590] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:53 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:54.779386 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:54.780598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: f561ba4f-0814-475b-8ad1-5e79cfe5b851] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:56:54.789253 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:54.789696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:54.790454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:56:54.790890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:56:54.804662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] HTTP exception thrown: Instance f561ba4f-0814-475b-8ad1-5e79cfe5b851 could not be found. Nov 02 12:56:54.805257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Returning 404 to user: Instance f561ba4f-0814-475b-8ad1-5e79cfe5b851 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:56:54.806087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-58abb3e5-2591-4383-afaa-fb390e6180ee tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851" status: 404 len: 111 microversion: 2.1 time: 0.034001 Nov 02 12:56:54.806627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 283/591] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:54 2022] GET /compute/v2.1/servers/f561ba4f-0814-475b-8ad1-5e79cfe5b851 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:57:09.330090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8caed05e-e94e-46a2-a622-cacb2d297fa1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:09.331316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8caed05e-e94e-46a2-a622-cacb2d297fa1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:09.337520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8caed05e-e94e-46a2-a622-cacb2d297fa1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:09.337963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8caed05e-e94e-46a2-a622-cacb2d297fa1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:09.338730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8caed05e-e94e-46a2-a622-cacb2d297fa1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:09.339159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8caed05e-e94e-46a2-a622-cacb2d297fa1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:09.608005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-52a405bc-30bf-4ad5-8634-f3c0f93ef168 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:09.608918 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-52a405bc-30bf-4ad5-8634-f3c0f93ef168 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:09.615708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a405bc-30bf-4ad5-8634-f3c0f93ef168 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:09.616157 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a405bc-30bf-4ad5-8634-f3c0f93ef168 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:09.616956 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a405bc-30bf-4ad5-8634-f3c0f93ef168 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:09.617379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-52a405bc-30bf-4ad5-8634-f3c0f93ef168 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:10.584383 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8caed05e-e94e-46a2-a622-cacb2d297fa1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action" status: 200 len: 28727 microversion: 2.1 time: 1.258427 Nov 02 12:57:10.584923 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 309/592] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:57:09 2022] POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action => generated 28727 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:57:11.003624 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-52a405bc-30bf-4ad5-8634-f3c0f93ef168 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/action" status: 200 len: 28569 microversion: 2.20 time: 1.399571 Nov 02 12:57:11.004240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 284/593] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Nov 2 12:57:09 2022] POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/action => generated 28569 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:57:12.018415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-780368637", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "networks": [{"uuid": "329375eb-0ff0-44d5-899a-7723bd92ed6a"}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:12.078801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] validate_networks() for [('329375eb-0ff0-44d5-899a-7723bd92ed6a', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 12:57:12.431054 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:57:12.431503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:57:12.432052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:57:12.432498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:57:12.432912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:57:12.442485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:12.442861 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:12.443663 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:12.444096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:12.462494 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Getting quotas for project 90b42fe203384f8c852afe1c917d4f40. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:12.466963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Getting quotas for user a05c9a5fa170471aa8d73e243ffc30b8 and project 90b42fe203384f8c852afe1c917d4f40. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:12.478282 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 12:57:12.480724 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 12:57:12.531779 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-540ec992-a0d9-401f-ba8e-3f599abf9f25 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519063 Nov 02 12:57:12.534114 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 310/594] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:57:12.544528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0733d8a4-d2de-4d21-b209-c61d02ab34d7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:12.545222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0733d8a4-d2de-4d21-b209-c61d02ab34d7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:12.607252 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0733d8a4-d2de-4d21-b209-c61d02ab34d7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:12.613908 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0733d8a4-d2de-4d21-b209-c61d02ab34d7 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1218 microversion: 2.1 time: 0.073540 Nov 02 12:57:12.614472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 285/595] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:12 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:13.638498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:13.639201 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:13.647274 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:13.647721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:13.648526 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:13.648958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:13.714683 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:13.725967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-67849ded-8501-47ac-8391-b1ca5037e2e1 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1222 microversion: 2.1 time: 0.091067 Nov 02 12:57:13.726648 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 311/596] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:13 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:14.757900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:14.758458 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:14.770205 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:14.770653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:14.771429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:14.771859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:14.839931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:14.848408 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d71428a5-9796-4bff-8395-1077d2852fd3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1222 microversion: 2.1 time: 0.097130 Nov 02 12:57:14.848935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 286/597] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:14 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:15.875307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:15.876341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:15.885001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:15.885455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:15.886230 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:15.886666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:15.951260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:15.959815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7481525b-e33e-4baf-b10c-ec1df3899e30 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1222 microversion: 2.1 time: 0.091213 Nov 02 12:57:15.960631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 312/598] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:15 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:16.983440 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:16.984078 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:16.991055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:16.991495 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:16.992307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:16.992726 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:17.055917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:17.063639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-91293b71-d341-44bc-a96d-f70c060fd3ce tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1278 microversion: 2.1 time: 0.084319 Nov 02 12:57:17.064187 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 287/599] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:16 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:18.087448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:18.088061 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:18.094567 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:18.095028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:18.095775 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:18.096221 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:18.246198 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:18.253812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8786923f-5158-4a1b-a0cc-9852308295a3 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.170379 Nov 02 12:57:18.254419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 313/600] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:18 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:18.532982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-37a34ab2-d767-4f38-af3e-2cca9d70a11d req-f5ebdd66-32e1-4753-88b6-d090537a69ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d772fb-813e-4f1a-b037-40004977b274", "tag": "03559c84-5782-47b1-aee2-ae9b654e9dba"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:18.542859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-37a34ab2-d767-4f38-af3e-2cca9d70a11d req-f5ebdd66-32e1-4753-88b6-d090537a69ad service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:18.543375 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-37a34ab2-d767-4f38-af3e-2cca9d70a11d req-f5ebdd66-32e1-4753-88b6-d090537a69ad service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:18.556062 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-37a34ab2-d767-4f38-af3e-2cca9d70a11d req-f5ebdd66-32e1-4753-88b6-d090537a69ad service nova] Creating event network-changed:03559c84-5782-47b1-aee2-ae9b654e9dba for instance c2d772fb-813e-4f1a-b037-40004977b274 on hv-cinder-86327 Nov 02 12:57:18.561110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-37a34ab2-d767-4f38-af3e-2cca9d70a11d req-f5ebdd66-32e1-4753-88b6-d090537a69ad service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031795 Nov 02 12:57:18.561755 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 288/601] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:19.277502 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:19.278834 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:19.285919 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:19.286332 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:19.287148 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:19.287573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:19.444546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:19.457557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f17988b9-c906-4f12-b1a4-ee4428c5cbe0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.184024 Nov 02 12:57:19.464745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 314/602] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:19 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:20.489154 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:20.489977 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:20.496624 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:20.497066 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:20.497819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:20.498250 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:20.639503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:20.648087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e84c64ee-8437-45e2-88bb-6a494ce55978 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.163826 Nov 02 12:57:20.648715 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 289/603] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:20 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:21.670612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:21.671346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:21.678111 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:21.678562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:21.679375 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:21.679812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:21.833049 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:21.840827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ffc93881-7fba-4500-8f7c-2992f8cb89c9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.174312 Nov 02 12:57:21.841412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 315/604] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:21 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:22.864140 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:22.865021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:22.872999 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:22.873546 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:22.874650 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:22.875327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:23.022858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.034305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-edfc62d7-46d8-40bc-9c71-e624aa19ee42 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.173846 Nov 02 12:57:23.035112 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 290/605] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:22 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:24.058503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:24.059324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:24.065912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:24.066303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:24.068392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:24.068392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:24.210438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:24.220813 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-af3a5650-cd58-4899-a957-43a449daac6b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.167153 Nov 02 12:57:24.221384 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 316/606] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:24 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:25.243017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:25.244607 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:25.251272 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:25.251723 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:25.252669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:25.253387 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:25.401488 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:25.409228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8b9343ce-5a2b-4d41-b1db-3b035119a88e tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.170082 Nov 02 12:57:25.410081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 291/607] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:25 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:26.432440 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:26.433026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:26.439800 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:26.440363 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:26.441294 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:26.441703 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:26.795346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:26.803412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-95fd9362-24d9-435f-907e-256e46476b56 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.374867 Nov 02 12:57:26.804585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 317/608] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:26 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:27.826866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:27.827568 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:27.834664 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:27.835122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:27.835933 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:27.836389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:28.127094 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:28.135113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c27c79e5-fadc-4464-aebf-5bf13371ebb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.312140 Nov 02 12:57:28.135688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 292/609] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:27 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:29.160796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:29.161493 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:29.169307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:29.169834 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:29.170714 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:29.171219 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:29.322404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:29.333961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a1cd344d-29d7-4a8a-bad7-b939c89f865a tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.177945 Nov 02 12:57:29.334902 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 318/610] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:29 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:29.902008 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-eea2552b-176f-4d67-8f92-2862a4b5595c req-cce9e3ec-6c21-496f-937a-e333fe6ba1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d772fb-813e-4f1a-b037-40004977b274", "name": "network-vif-plugged", "status": "completed", "tag": "03559c84-5782-47b1-aee2-ae9b654e9dba"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:29.911747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-eea2552b-176f-4d67-8f92-2862a4b5595c req-cce9e3ec-6c21-496f-937a-e333fe6ba1e4 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:29.912192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-eea2552b-176f-4d67-8f92-2862a4b5595c req-cce9e3ec-6c21-496f-937a-e333fe6ba1e4 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:29.924571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-eea2552b-176f-4d67-8f92-2862a4b5595c req-cce9e3ec-6c21-496f-937a-e333fe6ba1e4 service nova] Creating event network-vif-plugged:03559c84-5782-47b1-aee2-ae9b654e9dba for instance c2d772fb-813e-4f1a-b037-40004977b274 on hv-cinder-86327 Nov 02 12:57:29.929909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-eea2552b-176f-4d67-8f92-2862a4b5595c req-cce9e3ec-6c21-496f-937a-e333fe6ba1e4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031770 Nov 02 12:57:29.930551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 293/611] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:30.361947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:30.362621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:30.369570 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:30.370020 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:30.370786 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:30.371221 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:30.520175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:30.528563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2b934a7a-2115-4123-b04a-d99b8525eb36 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.171507 Nov 02 12:57:30.529078 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 319/612] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:30 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:31.562746 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:31.563437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:31.570486 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:31.570936 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:31.571701 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:31.572139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:31.712613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:31.720238 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-be7faaa3-94e6-4486-952f-c28f81de83c8 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.164683 Nov 02 12:57:31.720738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 294/613] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:31 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:32.744356 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:32.744956 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:32.752147 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:32.752629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:32.753402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:32.753834 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:32.907600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:32.915792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bd8199e7-8be0-4b25-b8bb-fa61e11ca5fc tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.175650 Nov 02 12:57:32.916384 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 320/614] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:32 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:33.942426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:33.943264 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:33.953465 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:33.954192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:33.955425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:33.956106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:34.105951 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:34.113732 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d0661825-7576-4235-88a6-84042af4f85b tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.177585 Nov 02 12:57:34.114300 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 295/615] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:33 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:35.139696 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:35.140568 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:35.150920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:35.151550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:35.152697 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:35.153310 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:35.323837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:35.331522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e176f9da-c0e5-488b-afa1-a3f8ccf07565 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.197486 Nov 02 12:57:35.332103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 321/616] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:35 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:36.355109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:36.355893 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:36.362911 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:36.363354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:36.364137 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:36.364593 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:36.520985 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:36.529320 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-21f8e22c-172b-4648-92e1-0a5f06ae1115 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.178899 Nov 02 12:57:36.529955 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 296/617] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:36 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:37.556858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:37.558110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:37.569487 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:37.570423 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:37.571234 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:37.571596 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:37.726383 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:37.738085 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f732b8fc-6b69-49a3-8d2f-cf444edf944d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.188257 Nov 02 12:57:37.739173 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 322/618] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:37 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:38.764833 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:38.765400 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:38.772797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:38.773249 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:38.774018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:38.774454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:38.926378 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:38.934132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-90cade87-082d-402f-8725-9107a9191a57 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.173299 Nov 02 12:57:38.934735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 297/619] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:38 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:39.327875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:57:39.328083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 12:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 12:57:39.963897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:39.964575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:39.971679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:39.972172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:39.972970 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:39.973404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:40.120445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:40.133520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6de4cbeb-ea50-42f1-8d3f-c9c0622e6a96 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.174946 Nov 02 12:57:40.134401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 323/620] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:39 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:41.164786 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:41.165529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:41.172677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:41.173120 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:41.173876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:41.174308 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:41.326571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:41.338039 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8755a673-d02d-4e55-9256-ec6fdac783d9 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.177884 Nov 02 12:57:41.338746 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 298/621] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:41 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:42.364781 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:42.365585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:42.374024 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:42.374475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:42.375247 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:42.375680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:42.515613 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:42.523758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-273cf352-4a73-4880-8389-a45ebc9be1ae tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1318 microversion: 2.1 time: 0.165092 Nov 02 12:57:42.524346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 324/622] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:42 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:43.546392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:43.547071 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:43.553657 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:43.554112 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:43.554911 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:43.555339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:43.698796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:43.710828 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-112f56bb-1cea-4cf8-b5a5-30b23c4dc5be tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1506 microversion: 2.1 time: 0.168072 Nov 02 12:57:43.711721 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 299/623] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:43 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:43.738564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-73ab70b0-6d03-4a5f-b45b-554904734d46 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b72c9c98-0cdb-41d3-bf9a-7cd0f4406c42", "device": "/dev/sdb"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:43.740505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-73ab70b0-6d03-4a5f-b45b-554904734d46 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:43.749975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73ab70b0-6d03-4a5f-b45b-554904734d46 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:43.750419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73ab70b0-6d03-4a5f-b45b-554904734d46 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:43.751183 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73ab70b0-6d03-4a5f-b45b-554904734d46 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:43.751607 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73ab70b0-6d03-4a5f-b45b-554904734d46 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:44.069272 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-73ab70b0-6d03-4a5f-b45b-554904734d46 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "POST /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336809 Nov 02 12:57:44.069919 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 325/624] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 12:57:43 2022] POST /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:59.706205 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-45ac3c41-2697-41c6-946c-295fe5a7bb73 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:59.706807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-45ac3c41-2697-41c6-946c-295fe5a7bb73 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:57:59.712861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45ac3c41-2697-41c6-946c-295fe5a7bb73 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:59.713281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45ac3c41-2697-41c6-946c-295fe5a7bb73 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:59.714036 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45ac3c41-2697-41c6-946c-295fe5a7bb73 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:57:59.714486 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45ac3c41-2697-41c6-946c-295fe5a7bb73 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:57:59.736515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-45ac3c41-2697-41c6-946c-295fe5a7bb73 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/ips" status: 200 len: 151 microversion: 2.20 time: 0.214773 Nov 02 12:57:59.737055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 300/625] 10.222.0.90 () {60 vars in 1289 bytes} [Wed Nov 2 12:57:59 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/ips => generated 151 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:58:07.030765 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:07.031866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:07.040311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:07.040860 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:07.041795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:07.042290 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:07.067587 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lazy-loading 'flavor' on Instance uuid 1839881d-97b0-4aa7-b398-2eeee344099f {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:58:07.338096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8cf416eb-26bf-4d39-8ae7-6dda8109bbb4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/action" status: 202 len: 0 microversion: 2.20 time: 0.311909 Nov 02 12:58:07.339267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 326/626] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Nov 2 12:58:07 2022] POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:58:07.349276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:07.350023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:07.369464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:07.370212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:07.371274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:07.372163 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:07.524336 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:07.533640 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:07.535305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:07.536581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-74f4400f-f6af-4e6c-9008-50e9496d6639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.192395 Nov 02 12:58:07.537212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 301/627] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:07 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:08.568570 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:08.569179 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:08.576058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:08.576538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:08.577313 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:08.577748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:08.727393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:08.735548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:08.737231 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:08.738387 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-51089b9d-74fd-4748-af11-fb77346f6f11 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.178241 Nov 02 12:58:08.738967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 327/628] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:08 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:08.917745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:08.918270 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:08.925384 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:08.925834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:08.926602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:08.927038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:09.051287 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lazy-loading 'services' on Instance uuid c2d772fb-813e-4f1a-b037-40004977b274 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:58:09.180194 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fda596f2-a3b8-4f5c-83b6-c0049e415e6d tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274/os-volume_attachments/b72c9c98-0cdb-41d3-bf9a-7cd0f4406c42" status: 202 len: 0 microversion: 2.1 time: 0.266361 Nov 02 12:58:09.180867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 302/629] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 12:58:08 2022] DELETE /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274/os-volume_attachments/b72c9c98-0cdb-41d3-bf9a-7cd0f4406c42 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:58:09.766206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:09.766803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:09.773658 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:09.774104 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:09.774872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:09.775325 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:09.912216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:09.920404 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:09.921923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:09.923142 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e4ac4240-ff2d-4848-9240-e775e9996d3d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.161975 Nov 02 12:58:09.929665 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 303/630] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:09 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:09.930776 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-629d3957-86c5-4d61-a7cf-f2c6c6eb03ae tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:09.931382 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-629d3957-86c5-4d61-a7cf-f2c6c6eb03ae tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:09.937730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629d3957-86c5-4d61-a7cf-f2c6c6eb03ae tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:09.938175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629d3957-86c5-4d61-a7cf-f2c6c6eb03ae tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:09.938950 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629d3957-86c5-4d61-a7cf-f2c6c6eb03ae tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:09.939544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629d3957-86c5-4d61-a7cf-f2c6c6eb03ae tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:09.962639 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-629d3957-86c5-4d61-a7cf-f2c6c6eb03ae tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/ips" status: 200 len: 144 microversion: 2.1 time: 0.266136 Nov 02 12:58:09.963246 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 328/631] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 12:58:09 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/ips => generated 144 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:10.949589 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:10.950153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:10.956627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:10.957075 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:10.957835 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:10.958440 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:11.113711 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:11.122615 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:11.124113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:11.125337 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-edc27787-fe7a-49b2-bf1e-ce0433feac1f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.179931 Nov 02 12:58:11.125905 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 304/632] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:10 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:11.376766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.377320 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:11.386791 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:11.387422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:11.388715 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:11.389145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:11.415582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 12:58:11.501036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3afc232b-1eeb-4283-8945-f4a36448fa9f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 204 len: 0 microversion: 2.1 time: 0.130119 Nov 02 12:58:11.501728 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 329/633] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:11 2022] DELETE /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:58:11.510492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.511112 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:11.518068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:11.518710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:11.519476 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:11.519930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:11.668881 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:11.681385 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d2399de9-cd07-42f3-a9fc-8b61be32cbb6 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1512 microversion: 2.1 time: 0.174660 Nov 02 12:58:11.682299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 305/634] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:11 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:12.153885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:12.154719 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:12.160791 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:12.161235 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:12.161992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:12.162443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:12.299266 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.309525 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.311448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.312657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5a5b3e7a-d6fe-4f0c-8941-70362722977f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.163067 Nov 02 12:58:12.313195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 330/635] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:58:12.708798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:12.709530 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:12.718361 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:12.719010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:12.719974 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:12.720642 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:12.864257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.876274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-423d27ee-83d3-4c3c-bf87-926f2eb713f0 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1512 microversion: 2.1 time: 0.172436 Nov 02 12:58:12.877105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 306/636] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:13.224522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-09dca510-9d07-4ab6-813f-a0bc65ee3bbf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7207c60a-9882-4554-b1f6-39c1bfb94156"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:13.225628 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-09dca510-9d07-4ab6-813f-a0bc65ee3bbf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:13.232967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-09dca510-9d07-4ab6-813f-a0bc65ee3bbf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:13.233534 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-09dca510-9d07-4ab6-813f-a0bc65ee3bbf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:13.234314 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-09dca510-9d07-4ab6-813f-a0bc65ee3bbf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:13.234752 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-09dca510-9d07-4ab6-813f-a0bc65ee3bbf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:13.341809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.342631 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:13.349822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:13.350328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:13.351113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:13.351574 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:13.497698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:13.506590 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:13.508525 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:13.510198 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ad2f22ab-2cf9-4dc5-a285-e8dbd0f75d30 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.174755 Nov 02 12:58:13.510764 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 307/637] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:13.530667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-09dca510-9d07-4ab6-813f-a0bc65ee3bbf tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310376 Nov 02 12:58:13.531362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 331/638] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 12:58:13 2022] POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:13.905592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.906219 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:13.913284 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:13.913733 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:13.914505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:13.914934 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:14.069595 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:14.078126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0a17c7cd-89de-4abe-8824-0051f0c3f10f tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1512 microversion: 2.1 time: 0.176765 Nov 02 12:58:14.078738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 308/639] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:14.539283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:14.539862 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:14.546450 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:14.546899 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:14.547636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:14.548102 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:14.717662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:14.726806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:14.728350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:14.729649 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e3c5245b-8ea5-43f0-9b06-a508e1e3f348 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.195306 Nov 02 12:58:14.730196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 332/640] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:14 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:14.731735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-16865c3d-60f6-46f4-8145-0702a6d3f886 req-10fbcf56-b256-4339-93cb-f9136a6f0c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d772fb-813e-4f1a-b037-40004977b274", "name": "network-vif-deleted", "tag": "03559c84-5782-47b1-aee2-ae9b654e9dba"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:14.740123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-16865c3d-60f6-46f4-8145-0702a6d3f886 req-10fbcf56-b256-4339-93cb-f9136a6f0c22 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:14.740601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-16865c3d-60f6-46f4-8145-0702a6d3f886 req-10fbcf56-b256-4339-93cb-f9136a6f0c22 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:14.751946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-16865c3d-60f6-46f4-8145-0702a6d3f886 req-10fbcf56-b256-4339-93cb-f9136a6f0c22 service nova] Creating event network-vif-deleted:03559c84-5782-47b1-aee2-ae9b654e9dba for instance c2d772fb-813e-4f1a-b037-40004977b274 on hv-cinder-86327 Nov 02 12:58:14.757068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-16865c3d-60f6-46f4-8145-0702a6d3f886 req-10fbcf56-b256-4339-93cb-f9136a6f0c22 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095175 Nov 02 12:58:14.758027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 309/641] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:15.104296 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:15.105283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:15.112730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:15.113226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:15.114181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:15.114729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:15.148796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:15.149239 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:15.149691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lazy-loading 'fault' on Instance uuid c2d772fb-813e-4f1a-b037-40004977b274 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:58:15.199872 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05c9a5fa170471aa8d73e243ffc30b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b42fe203384f8c852afe1c917d4f40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:15.207821 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aed29611-c8d5-447b-ab43-9b24d102ff11 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 200 len: 1308 microversion: 2.1 time: 0.109309 Nov 02 12:58:15.208652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 333/642] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:15 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:15.759090 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:15.759781 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:15.766396 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:15.766867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:15.769678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:15.770126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:15.933023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:15.943570 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:15.945118 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:15.946308 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bcf21bf5-95c3-4177-81c3-6c7d53292cc5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.192016 Nov 02 12:58:15.946868 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 310/643] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:15 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:16.231729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:16.232617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] [instance: c2d772fb-813e-4f1a-b037-40004977b274] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:16.241057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:16.241736 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:16.243019 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:16.243790 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:16.259501 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] HTTP exception thrown: Instance c2d772fb-813e-4f1a-b037-40004977b274 could not be found. Nov 02 12:58:16.260461 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] Returning 404 to user: Instance c2d772fb-813e-4f1a-b037-40004977b274 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:58:16.262169 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ad80c82d-3667-4dcc-bfa6-f49386517d29 tempest-VolumesSnapshotTestJSON-1145873476 tempest-VolumesSnapshotTestJSON-1145873476-project] 10.222.0.90 "GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274" status: 404 len: 111 microversion: 2.1 time: 0.034323 Nov 02 12:58:16.262828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 334/644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:16 2022] GET /compute/v2.1/servers/c2d772fb-813e-4f1a-b037-40004977b274 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:16.975442 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:16.976176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:16.986227 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:16.986969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:16.988454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:16.989003 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:17.155537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:17.167815 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:17.170234 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:17.171892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2cf89333-fc72-45f7-aec6-9f2225fcfd85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.201080 Nov 02 12:58:17.172514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 311/645] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:16 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:18.203671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:18.204283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:18.211230 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:18.211687 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:18.212477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:18.212901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:18.363770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:18.373356 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:18.374972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:18.376165 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ba12bbd7-c7b4-489f-b468-bfc1cbe02bf5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.179613 Nov 02 12:58:18.376844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 335/646] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:18 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:19.422262 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:19.423102 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:19.430428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:19.430875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:19.432024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:19.432482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:19.597851 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:19.606903 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:19.608624 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:19.609851 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-972a31d5-270a-4434-b043-da31170bce60 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.192168 Nov 02 12:58:19.610449 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 312/647] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:19 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:20.638681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:20.639258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:20.650352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:20.650778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:20.651556 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:20.652156 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:20.838803 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:20.849817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:20.851342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:20.852663 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-377b6e8a-55e5-4259-802f-57c0f7d6b3d2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.220117 Nov 02 12:58:20.853214 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 336/648] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:20 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:21.881444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:21.882037 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:21.891642 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:21.892086 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:21.892917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:21.893351 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:22.041947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:22.051193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:22.053343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:22.054012 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6282b012-d491-4cef-bc5d-0639ddc3987e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.177210 Nov 02 12:58:22.054602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 313/649] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:21 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:23.083852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:23.084804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:23.095018 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:23.095447 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:23.096459 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:23.096890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:23.247824 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:23.261511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:23.264000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:23.266168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b6a00c10-5849-4918-ad12-319115ec4c8d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.189101 Nov 02 12:58:23.266734 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 337/650] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:23 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:24.299627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:24.300342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:24.306984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:24.307414 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:24.308165 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:24.308702 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:24.463863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:24.473151 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:24.474631 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:24.475987 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bab67e13-2989-47b1-8530-035e7b123ff8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.180492 Nov 02 12:58:24.476455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 314/651] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:24 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:25.502356 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:25.503326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:25.510240 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:25.510722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:25.511694 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:25.512280 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:25.665191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:25.673158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:25.674777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:25.675948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9d2f852d-df73-4d38-b89a-095ebf3dd4ab tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.177641 Nov 02 12:58:25.676559 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 338/652] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:25 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:26.424523 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ae8abfea-ba5c-4d97-a3af-baedd7a7c58d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:26.431521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ae8abfea-ba5c-4d97-a3af-baedd7a7c58d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:26.431982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ae8abfea-ba5c-4d97-a3af-baedd7a7c58d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:26.496700 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ae8abfea-ba5c-4d97-a3af-baedd7a7c58d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Going to try to stop instance {{(pid=124278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Nov 02 12:58:26.543880 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ae8abfea-ba5c-4d97-a3af-baedd7a7c58d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action" status: 202 len: 0 microversion: 2.1 time: 0.123120 Nov 02 12:58:26.544471 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 315/653] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:58:26 2022] POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:58:26.553028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:26.553639 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:26.560765 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:26.561225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:26.562020 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:26.562415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:26.701981 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:26.703162 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:26.710403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:26.711285 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:26.713118 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:26.714633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:26.725641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:26.737015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a45023ba-7127-4192-8011-407e3a196357 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.187952 Nov 02 12:58:26.737611 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 339/654] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:26 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:26.891951 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:26.902214 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:26.903762 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:26.904994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-167c3c09-3f73-43e7-9f9b-fc57a446b7d0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.207761 Nov 02 12:58:26.905910 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 316/655] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:26 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:27.762655 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:27.763344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:27.770520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:27.770973 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:27.771745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:27.772172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:27.922910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:27.932522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3b64a58c-85f1-4ad2-98d4-db9c0c2aadc2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.173806 Nov 02 12:58:27.933106 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 340/656] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:27 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:27.945252 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:27.945822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:27.952507 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:27.952968 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:27.953740 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:27.954286 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:28.105564 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:28.114021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:28.115561 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:28.116861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0ad0014c-a33a-42df-bf16-0c91eb361977 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.175633 Nov 02 12:58:28.117426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 317/657] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:27 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:28.956955 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:28.957568 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:28.964395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:28.964848 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:28.965614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:28.966051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:29.115383 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:29.123805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fb01ed05-4d61-45a2-b7e3-b43b09d7de0c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.170907 Nov 02 12:58:29.124402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 341/658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:28 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:29.143395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:29.144005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:29.150427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:29.150865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:29.151622 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:29.152046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:29.298883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:29.307318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:29.308901 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:29.310082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4b08d016-8692-49b2-9df9-7a00beb934a9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.171278 Nov 02 12:58:29.310649 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 318/659] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:29 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:30.150499 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:30.151166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:30.158306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:30.158802 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:30.159600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:30.160064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:30.316915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:30.325280 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-72715d55-e630-411b-a4d7-0d403b4462d4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.180442 Nov 02 12:58:30.325892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 342/660] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:30 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:30.335075 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:30.335717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:30.342717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:30.343175 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:30.343990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:30.344472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:30.498539 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:30.507074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:30.508598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:30.509756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e5f283ae-207f-48f6-9207-fc82604aa1fb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.178777 Nov 02 12:58:30.510557 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 319/661] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:30 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:31.351371 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:31.352028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:31.362185 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:31.362733 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:31.363504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:31.363936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:31.516133 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.524540 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-997b0c7e-d061-4a57-83a2-4d8340b29dbb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.179549 Nov 02 12:58:31.525105 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 343/662] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:31 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:31.535023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:31.535717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:31.542397 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:31.542852 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:31.543760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:31.544191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:31.698963 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.707984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.709509 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.710656 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3c52ae0b-5ab7-438e-bd39-a22dc9cbeb80 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.179621 Nov 02 12:58:31.711185 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 320/663] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:31 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:32.550838 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:32.551421 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:32.558529 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:32.558978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:32.559759 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:32.560187 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:32.697626 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:32.706489 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4b5afa41-db27-4054-8b82-cf8c02624038 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.159853 Nov 02 12:58:32.707093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 344/664] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:32 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:32.736873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:32.737483 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:32.744467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:32.744915 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:32.745685 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:32.746111 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:32.891000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:32.900798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:32.902612 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:32.903791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1cebf7ce-980d-4342-a515-f1c16543740a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.171259 Nov 02 12:58:32.904400 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 321/665] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:32 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:33.731556 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:33.732158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:33.739075 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:33.739542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:33.740337 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:33.740770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:33.833600 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-49f42ed5-1d68-4d83-8a32-51ae378fb45f req-20f0a4d0-6ec7-4237-b75a-248d98214814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1839881d-97b0-4aa7-b398-2eeee344099f", "name": "network-vif-plugged", "status": "completed", "tag": "7a7f193c-8f61-4df5-8e3c-0d69f95daa2f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:33.842135 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-49f42ed5-1d68-4d83-8a32-51ae378fb45f req-20f0a4d0-6ec7-4237-b75a-248d98214814 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:33.842667 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-49f42ed5-1d68-4d83-8a32-51ae378fb45f req-20f0a4d0-6ec7-4237-b75a-248d98214814 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:33.855876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-49f42ed5-1d68-4d83-8a32-51ae378fb45f req-20f0a4d0-6ec7-4237-b75a-248d98214814 service nova] Creating event network-vif-plugged:7a7f193c-8f61-4df5-8e3c-0d69f95daa2f for instance 1839881d-97b0-4aa7-b398-2eeee344099f on hv-cinder-86327 Nov 02 12:58:33.861278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-49f42ed5-1d68-4d83-8a32-51ae378fb45f req-20f0a4d0-6ec7-4237-b75a-248d98214814 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089447 Nov 02 12:58:33.862048 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 322/666] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:33.893181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:33.902976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3ec23304-903b-4a7e-b65e-0be02523d979 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.175421 Nov 02 12:58:33.903870 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 345/667] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:33 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:33.930459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:33.931157 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:33.937477 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:33.937924 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:33.938692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:33.939110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:34.083418 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:34.092026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:34.093569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:34.094731 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3059f705-798a-4bb7-a102-a68578ef7f5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.168847 Nov 02 12:58:34.095354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 323/668] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:33 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:34.934497 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:34.935128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:34.942360 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:34.942823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:34.943598 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:34.944046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:35.087982 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:35.097485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-738566c9-d380-4b9e-bc5a-dc530062c0b9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.166979 Nov 02 12:58:35.098072 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 346/669] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:34 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:35.120271 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:35.120961 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:35.127472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:35.127916 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:35.128703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:35.129134 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:35.276281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:35.287822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:35.289686 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:35.290915 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0771025e-bca2-4574-a3bc-f32cf0ed5d74 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.174551 Nov 02 12:58:35.291886 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 324/670] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:35 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:36.126450 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:36.127465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:36.138869 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:36.139694 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:36.141472 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:36.142171 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:36.307453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.315834 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-791ec08e-8b0f-4f99-8867-38dbd52d9651 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.196097 Nov 02 12:58:36.316421 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 347/671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:36 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:36.326754 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:36.327377 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:36.334635 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:36.335081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:36.335874 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:36.336354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:36.482935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.491598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.493163 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.494372 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-811690c6-2072-442a-afe8-bd9ef872e21b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.171558 Nov 02 12:58:36.494952 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 325/672] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:36 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:37.340130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:37.340751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:37.347750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:37.348261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:37.349055 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:37.349470 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:37.503288 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:37.512295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-be93c625-526c-4cf0-96fd-c40a1b72fd3c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.175800 Nov 02 12:58:37.515449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 348/673] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:37 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:37.524865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:37.525561 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:37.532373 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:37.532822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:37.533762 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:37.534305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:37.676080 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:37.684762 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:37.686410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:37.687795 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b19c2a87-b1b1-422c-b8c2-5f3aa362671e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.167007 Nov 02 12:58:37.688492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 326/674] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:37 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:38.536168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:38.536945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:38.545174 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:38.545636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:38.546425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:38.546901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:38.694129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.706393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f2b5d066-1d93-4616-8e9e-f30c04fd87f2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.174457 Nov 02 12:58:38.707244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 349/675] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:38 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:38.715079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:38.715897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:38.722791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:38.723239 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:38.724040 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:38.724549 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:38.869357 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.878431 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.879925 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.881139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-45a90643-7366-43e2-9854-771fa4fce2f1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.170105 Nov 02 12:58:38.881804 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 327/676] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:38 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:39.733006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:39.733585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:39.740052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:39.740527 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:39.741306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:39.741736 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:39.882456 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:39.891433 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-467e46fa-9ed8-438d-adb0-68c1b65e89cb tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.163007 Nov 02 12:58:39.892032 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 350/677] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:39 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:39.907574 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:39.908336 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:39.915161 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:39.915604 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:39.916427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:39.916858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:40.062544 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:40.071450 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:40.073028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:40.074189 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-07dfeb84-2487-4d3f-a75a-0c71002147e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1745 microversion: 2.20 time: 0.170948 Nov 02 12:58:40.074781 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 328/678] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:39 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:40.917232 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:40.917974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:40.925532 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:40.926537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:40.927603 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:40.928060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:41.079751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:41.089351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-03b83d38-db4d-4512-a713-51aa00c6b8d5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.178157 Nov 02 12:58:41.090533 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 351/679] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:40 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:41.100358 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:41.102005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:41.112820 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:41.113707 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:41.114739 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:41.115245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:41.257758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:41.268153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:41.269748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:41.271255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9eea7d24-aaa8-4f32-a998-2146d2361d3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.176168 Nov 02 12:58:41.276399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 329/680] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:41 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:42.134321 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:42.136328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:42.147893 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:42.148608 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:42.150003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:42.150852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:42.304380 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:42.306561 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:42.318412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:42.319395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:42.321139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:42.322368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:42.343826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:42.371769 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4d234e8b-af29-4c15-adc8-e0ef3dc757b4 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.244246 Nov 02 12:58:42.373152 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 352/681] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:42 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:42.505391 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:42.517504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:42.519534 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:42.520727 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ca172052-a269-4fbf-92b4-5c1448b15266 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.224293 Nov 02 12:58:42.521290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 330/682] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:42 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:58:43.397243 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:43.397855 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:43.404780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:43.405229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:43.406003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:43.406686 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:43.547105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:43.548641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:43.555924 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:43.556876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:43.557941 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:43.558669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:43.604138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:43.616798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-86525ae4-8b60-449c-ad9d-68bc47a78cce tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.223412 Nov 02 12:58:43.618586 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 353/683] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:43 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:43.756108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:43.770434 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:43.772074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:43.773335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b6ede84b-14bd-4b02-9031-993855c16e5a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.230113 Nov 02 12:58:43.773900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 331/684] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:43 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:44.649010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:44.649767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:44.657481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:44.658128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:44.658997 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:44.659592 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:44.805887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:44.807157 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:44.815196 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:44.815656 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:44.816666 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:44.817298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:44.834512 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:44.846559 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-be58dfbc-3e97-4456-bf5f-4a7662305801 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.201844 Nov 02 12:58:44.865434 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 354/685] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:44 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:45.134447 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:45.145315 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:45.147243 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:45.149065 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2df810e8-5db0-4199-bc4f-e7c156d595b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.350249 Nov 02 12:58:45.151189 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 332/686] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:44 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:45.877220 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:45.877784 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:45.884821 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:45.885477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:45.886422 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:45.886880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:46.052648 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:46.062340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-733d3707-d2c7-45fd-b92d-092e9e77e3e8 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.189889 Nov 02 12:58:46.062939 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 355/687] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:45 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:46.216240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:46.218133 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:46.228008 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:46.228750 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:46.229989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:46.231343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:46.525482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:46.535410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:46.537317 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:46.538562 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-75b4c9b5-28e8-4858-a1bc-05198b610ddd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.329832 Nov 02 12:58:46.544268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 333/688] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:46 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:47.089138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:47.090054 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:47.097069 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:47.097820 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:47.098666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:47.099154 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:47.330656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:47.342575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b33a8754-402f-44e9-8ddc-15943456d74e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1722 microversion: 2.1 time: 0.257290 Nov 02 12:58:47.343438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 356/689] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:47 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:47.567259 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:47.568927 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:47.577503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:47.578259 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:47.579303 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:47.579901 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:47.840309 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:47.851455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:47.854377 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:47.856103 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2a364e4b-c4b2-472d-8544-130bfaf135ad tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.293105 Nov 02 12:58:47.856974 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 334/690] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:47 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:48.368064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.368865 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:48.379878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:48.380908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:48.382647 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:48.383276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:48.591364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:48.600571 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-55f03a87-b3dc-41e5-abbd-3bbcedc3b900 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1699 microversion: 2.1 time: 0.236875 Nov 02 12:58:48.601472 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 357/691] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1699 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:48.630343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8543f784-a927-4f62-b27f-03a46d044366 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:48.640766 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8543f784-a927-4f62-b27f-03a46d044366 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:48.641515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8543f784-a927-4f62-b27f-03a46d044366 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:48.672123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8543f784-a927-4f62-b27f-03a46d044366 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Going to try to start instance {{(pid=124278) start /opt/stack/nova/nova/compute/api.py:2730}} Nov 02 12:58:48.743278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8543f784-a927-4f62-b27f-03a46d044366 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action" status: 202 len: 0 microversion: 2.1 time: 0.116014 Nov 02 12:58:48.746024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 335/692] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:58:48 2022] POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:58:48.756490 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.758909 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:48.768814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:48.769872 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:48.772544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:48.773638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:48.894435 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:48.895404 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:48.917540 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:48.918634 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:48.920721 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:48.926900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:48.982900 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:48.993077 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6f530d26-6247-4700-b6b1-1f40b462e661 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1708 microversion: 2.1 time: 0.241564 Nov 02 12:58:48.995996 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 358/693] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1708 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:49.217738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:49.227735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:49.229528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:49.230946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-245556d3-c7ac-40d6-9062-59be025d3bf2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.344052 Nov 02 12:58:49.231715 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 336/694] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:48 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:58:50.020419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:50.021850 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:50.029426 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:50.030125 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:50.031051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:50.031676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:50.199321 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:50.210619 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dd1661ff-ea94-4949-9c78-b19beac2e12d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1708 microversion: 2.1 time: 0.194210 Nov 02 12:58:50.211230 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 359/695] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:50 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1708 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:50.275366 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:50.281862 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:50.285870 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:50.286305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:50.287153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:50.287875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:50.450417 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:50.462241 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:50.464509 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:50.466229 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-222f9140-cd59-4545-8b30-5ed80c8a6219 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.197957 Nov 02 12:58:50.467497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 337/696] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:50 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:51.234741 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:51.235372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:51.243093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:51.243614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:51.244778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:51.245218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:51.394888 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:51.403727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ea116c50-63cc-4de4-96f9-ea3cacdca257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1712 microversion: 2.1 time: 0.172728 Nov 02 12:58:51.404333 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 360/697] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:51 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1712 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:51.502668 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:51.503351 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:51.510613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:51.511066 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:51.511854 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:51.512339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:51.663328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:51.672091 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:51.673623 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:51.674866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-09355ac6-1135-4268-95f5-25a0cac02485 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1740 microversion: 2.20 time: 0.176547 Nov 02 12:58:51.675644 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 338/698] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:51 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:52.701536 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:52.702158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:52.708910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:52.709451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:52.710626 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:52.711026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:52.856425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:52.864827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:52.866452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:52.867635 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d81cf613-42c2-45c0-87c6-a31efd1e9dc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1722 microversion: 2.20 time: 0.170088 Nov 02 12:58:52.868497 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 361/699] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:52 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:53.894680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:53.895226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:53.901950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:53.902427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:53.903229 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:53.903664 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:54.062245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:54.071145 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:54.072705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:54.073897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a5834ef4-6c49-47e0-be53-2d49fdf31206 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1722 microversion: 2.20 time: 0.183387 Nov 02 12:58:54.074462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 339/700] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:53 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:55.100073 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:55.100694 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:55.109761 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.110505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:55.111806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.112618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:55.260033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:55.269836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:55.271805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:55.273585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f75b81d4-10d0-41c6-b382-d56efde832e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1665 microversion: 2.20 time: 0.177886 Nov 02 12:58:55.274397 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 362/701] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:55 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:55.302134 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a6cef34e-6795-495d-a531-eb79bea58549 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34a5d42c-e4fb-40e5-b6c7-0cb98fe35105"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:55.303217 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a6cef34e-6795-495d-a531-eb79bea58549 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:55.310074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a6cef34e-6795-495d-a531-eb79bea58549 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.310549 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a6cef34e-6795-495d-a531-eb79bea58549 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:55.311467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a6cef34e-6795-495d-a531-eb79bea58549 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.311897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a6cef34e-6795-495d-a531-eb79bea58549 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:55.631176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a6cef34e-6795-495d-a531-eb79bea58549 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333170 Nov 02 12:58:55.631796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 340/702] 10.222.0.90 () {62 vars in 1364 bytes} [Wed Nov 2 12:58:55 2022] POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments => generated 188 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:58:55.767155 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-832cce6e-5f26-4970-9d44-0e7009e9d8cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:55.768101 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-832cce6e-5f26-4970-9d44-0e7009e9d8cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:55.774486 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-832cce6e-5f26-4970-9d44-0e7009e9d8cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.774931 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-832cce6e-5f26-4970-9d44-0e7009e9d8cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:55.775707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-832cce6e-5f26-4970-9d44-0e7009e9d8cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.776146 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-832cce6e-5f26-4970-9d44-0e7009e9d8cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:55.977602 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-832cce6e-5f26-4970-9d44-0e7009e9d8cd tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/action" status: 202 len: 0 microversion: 2.20 time: 0.213887 Nov 02 12:58:55.977602 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 363/703] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Nov 2 12:58:55 2022] POST /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:58:55.986429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:55.987142 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:55.994156 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.994681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:55.995529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:55.996028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:56.140296 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:56.149405 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:56.150892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:56.152041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-98d34c95-79b5-4e1f-ae55-1587bd138c44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1751 microversion: 2.20 time: 0.170358 Nov 02 12:58:56.152858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 341/704] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:55 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:56.550893 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-5497d0d5-bdee-43e7-8d0e-4190a0c5b911 req-378ebe15-375b-4ce6-926d-d9b9d2d6350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1839881d-97b0-4aa7-b398-2eeee344099f", "name": "network-vif-unplugged", "status": "completed", "tag": "7a7f193c-8f61-4df5-8e3c-0d69f95daa2f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:56.561228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5497d0d5-bdee-43e7-8d0e-4190a0c5b911 req-378ebe15-375b-4ce6-926d-d9b9d2d6350d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:56.561734 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5497d0d5-bdee-43e7-8d0e-4190a0c5b911 req-378ebe15-375b-4ce6-926d-d9b9d2d6350d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:56.577942 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.compute.server_external_events [req-5497d0d5-bdee-43e7-8d0e-4190a0c5b911 req-378ebe15-375b-4ce6-926d-d9b9d2d6350d service nova] Unable to find a host for instance 1839881d-97b0-4aa7-b398-2eeee344099f. Dropping event network-vif-unplugged {{(pid=124277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Nov 02 12:58:56.578931 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-5497d0d5-bdee-43e7-8d0e-4190a0c5b911 req-378ebe15-375b-4ce6-926d-d9b9d2d6350d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033501 Nov 02 12:58:56.580189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 364/705] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:58:57.178648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:57.179258 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:57.187246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:57.188022 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:57.189031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:57.189620 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:57.336923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:57.345749 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:57.347226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:57.348450 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-356e69c1-02d1-4d36-8301-a156ff3f2f63 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1751 microversion: 2.20 time: 0.174299 Nov 02 12:58:57.349045 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 342/706] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:57 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:58.374240 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:58.374833 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:58.382010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:58.382444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:58.383210 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:58.383637 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:58.535984 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:58.545977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:58.547396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:58.548642 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8adcb1ec-d09d-4ae1-b8dc-93176cb6ef87 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.178493 Nov 02 12:58:58.549309 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 365/707] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:58 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:58:59.577040 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:59.577676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:58:59.584863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:59.585286 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:59.586100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:58:59.586579 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:58:59.737008 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:59.745705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:59.747168 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:59.748368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fe5a0f1a-9896-4731-a2f0-4f4b7eaa6dd6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.175350 Nov 02 12:58:59.748937 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 343/708] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:58:59 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:59:00.775793 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:00.776656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:00.784914 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:00.785651 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:00.786737 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:00.787311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:00.940870 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:00.950808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:00.952357 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:00.953554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-694242b7-aee5-4655-8d5c-5bff7121fdbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.182319 Nov 02 12:59:00.954348 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 366/709] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:00 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:01.980714 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:01.981330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:01.988540 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:01.988991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:01.989788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:01.990226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:02.138136 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:02.147279 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:02.148914 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:02.150200 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9b472c7b-2ae3-44d6-b081-c6ef266f95ed tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.173810 Nov 02 12:59:02.151007 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 344/710] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:01 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:03.178409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:03.179137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:03.186256 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:03.186948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:03.187904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:03.188519 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:03.330343 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:03.339635 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:03.341500 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:03.343105 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-383dc144-d0bf-47d0-9e4f-2e9b7317ed6f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.170153 Nov 02 12:59:03.343667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 367/711] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:03 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:04.369406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:04.370094 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:04.376976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:04.377424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:04.378226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:04.378659 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:04.522579 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:04.531628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:04.533447 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:04.534614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6b46e17c-704e-46cc-bdff-a4b1ccaba57e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.169299 Nov 02 12:59:04.535529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 345/712] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:04 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:05.561427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:05.562139 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:05.569713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:05.570269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:05.571352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:05.571814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:05.720143 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:05.729740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:05.731231 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:05.732505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c1d2b830-3836-4be5-a89d-a2523c43f9db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.175433 Nov 02 12:59:05.733295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 368/713] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:05 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:06.759506 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:06.760171 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:06.767331 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:06.767775 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:06.768578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:06.769006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:06.910995 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:06.920007 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:06.921537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:06.922915 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2ff97194-1581-46e9-a790-38a08a1e472f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.167301 Nov 02 12:59:06.923485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 346/714] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:06 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:07.950443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:07.951236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:07.957921 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:07.958362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:07.959123 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:07.959665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:08.106294 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:08.114977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:08.116524 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:08.117689 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7f1805ed-5946-41a0-9dc6-249920d608a6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.171190 Nov 02 12:59:08.118265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 369/715] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:07 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:09.143804 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:09.144551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:09.151313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:09.151757 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:09.152550 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:09.152980 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:09.300989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:09.309898 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:09.311403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:09.312626 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-79e6107a-72c6-422c-a538-28f719b72a62 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.173066 Nov 02 12:59:09.313391 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 347/716] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:09 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:10.339351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:10.340113 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:10.347395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:10.347858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:10.348705 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:10.349140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:10.490758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:10.499998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:10.501770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:10.502948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8ae6daba-69ba-4c26-b774-199e26756091 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.168273 Nov 02 12:59:10.503766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 370/717] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:10 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:11.531897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:11.533438 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:11.544912 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:11.545478 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:11.546471 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:11.546993 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:11.697591 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:11.707792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:11.709331 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:11.710516 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b063328f-0cfa-42d6-924c-555bb983b1cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.184756 Nov 02 12:59:11.711094 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 348/718] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:11 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:12.742213 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:12.742904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:12.749871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:12.750318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:12.751193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:12.751616 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:12.909937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:12.923753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:12.926656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:12.928570 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-039136f1-582b-4300-b49d-32bda780dd38 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.190140 Nov 02 12:59:12.929475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 371/719] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:12 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:13.955270 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:13.955947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:13.963194 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:13.963648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:13.964464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:13.964890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:14.107276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:14.116515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:14.117996 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:14.119295 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9ca568cb-f22c-48b2-b155-3780b52cefc1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.168063 Nov 02 12:59:14.119863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 349/720] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:13 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:15.145510 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:15.146158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:15.153192 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:15.153644 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:15.154401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:15.154836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:15.304578 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:15.313233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:15.314811 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:15.316001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c64e5816-b4ae-45a7-be44-01ee05dd77e2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.174643 Nov 02 12:59:15.316660 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 372/721] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:15 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:16.349102 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:16.349696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:16.359477 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:16.359920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:16.360736 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:16.361174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:16.506421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:16.516735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:16.517487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:16.519155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cb790091-2bbd-4a6a-91a2-f7489c8ef028 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.176936 Nov 02 12:59:16.519324 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 350/722] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:16 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:17.547630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:17.548265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:17.555064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:17.555537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:17.556362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:17.556798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:17.705452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:17.714301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:17.716023 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:17.717254 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0dd8c213-6187-43a6-b53a-b2e62f0d86b2 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.174294 Nov 02 12:59:17.717757 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 373/723] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:17 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:18.745746 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:18.746506 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:18.754594 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:18.755057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:18.755825 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:18.756284 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:19.017324 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:19.026186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:19.027683 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:19.028909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-589d3d7c-ed5f-4653-89ff-d44ae7d43301 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.289696 Nov 02 12:59:19.029441 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 351/724] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:18 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:20.058950 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:20.059650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:20.070095 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:20.070734 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:20.071930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:20.072604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:20.219126 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:20.228568 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:20.230058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:20.231309 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-488889e5-4fdf-410f-93f0-59631f3e1f4c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.178980 Nov 02 12:59:20.231917 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 374/725] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:20 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:21.259226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:21.259922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:21.268739 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:21.269196 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:21.269976 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:21.270412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:21.424228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:21.432856 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:21.434345 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:21.435501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a5d2de83-2daa-4596-91ec-2469caa47314 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.181447 Nov 02 12:59:21.436088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 352/726] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:21 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:22.462657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:22.463448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:22.471045 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:22.471519 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:22.472330 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:22.472769 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:22.617400 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:22.626018 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:22.627513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:22.628692 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d301746c-916e-4976-8f5b-668b23738c85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.171191 Nov 02 12:59:22.629276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 375/727] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:22 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:23.655283 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:23.655926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:23.664922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:23.665594 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:23.666705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:23.667145 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:23.820721 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:23.833002 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:23.834481 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:23.835643 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-833321b6-1c05-4c65-a973-2aecacc688bc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.184442 Nov 02 12:59:23.836245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 353/728] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:23 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:24.864072 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:24.864721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:24.871510 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:24.871965 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:24.872772 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:24.873208 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:25.029766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:25.040193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:25.041725 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:25.042879 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b960bec8-bad7-4b43-a8ca-fc27893a17fc tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.183857 Nov 02 12:59:25.043454 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 376/729] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:24 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:26.075464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:26.076108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:26.083042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:26.083486 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:26.084292 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:26.084723 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:26.468935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:26.478406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:26.479891 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:26.481112 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8ca9c3aa-f68d-4889-bea6-0407bb984490 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.409706 Nov 02 12:59:26.481671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 354/730] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:26 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:27.507720 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:27.508330 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:27.515316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:27.515770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:27.516567 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:27.517086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:27.657583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:27.667221 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:27.668731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:27.669896 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7b318258-8884-4c84-9a6b-ece3513321cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.166599 Nov 02 12:59:27.670452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 377/731] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:27 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:28.697544 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:28.698219 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:28.705236 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:28.705692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:28.706705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:28.707158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:28.843017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-7c2f8025-560d-4c8b-a439-535a2546d49d req-0f09df88-557b-408b-bb4a-9cb17626c5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1839881d-97b0-4aa7-b398-2eeee344099f", "name": "network-vif-plugged", "status": "completed", "tag": "7a7f193c-8f61-4df5-8e3c-0d69f95daa2f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:28.851967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-7c2f8025-560d-4c8b-a439-535a2546d49d req-0f09df88-557b-408b-bb4a-9cb17626c5fc service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:28.852479 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-7c2f8025-560d-4c8b-a439-535a2546d49d req-0f09df88-557b-408b-bb4a-9cb17626c5fc service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:28.860498 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:28.866145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-7c2f8025-560d-4c8b-a439-535a2546d49d req-0f09df88-557b-408b-bb4a-9cb17626c5fc service nova] Creating event network-vif-plugged:7a7f193c-8f61-4df5-8e3c-0d69f95daa2f for instance 1839881d-97b0-4aa7-b398-2eeee344099f on hv-cinder-86327 Nov 02 12:59:28.871662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-7c2f8025-560d-4c8b-a439-535a2546d49d req-0f09df88-557b-408b-bb4a-9cb17626c5fc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032955 Nov 02 12:59:28.871860 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:28.872488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 378/732] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:28.873531 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:28.874712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d7a7e4e2-25c8-4e48-b4d6-7d9d019988d9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.181576 Nov 02 12:59:28.875302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 355/733] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:28 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:29.907751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:29.909758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:29.917196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:29.917641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:29.918412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:29.918845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:30.249876 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:30.262770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:30.265112 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:30.266539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e9f01072-a8af-4a84-a8dd-ce4f7445973a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.367155 Nov 02 12:59:30.267434 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 379/734] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:29 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:31.299132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:31.299827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:31.306910 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:31.307360 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:31.308124 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:31.308625 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:31.446977 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:31.455703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:31.457334 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:31.458595 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-705d06a9-b7e4-4933-989c-42a4936be19d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1809 microversion: 2.20 time: 0.165434 Nov 02 12:59:31.459155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 356/735] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:31 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:32.487553 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:32.488158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:32.495836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:32.496609 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:32.497662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:32.498231 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:32.645825 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:32.658735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:32.660924 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:32.662624 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3a46390b-b8d3-4d4a-9b30-f6204bb640e5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1796 microversion: 2.20 time: 0.181345 Nov 02 12:59:32.663373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 380/736] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 12:59:32 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1796 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:59:33.995761 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c5202713-277f-4eba-969f-6b69b6499d20 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a5560e6-5492-40bc-abb6-b19e22cecbdd"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:33.996947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c5202713-277f-4eba-969f-6b69b6499d20 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:34.003761 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c5202713-277f-4eba-969f-6b69b6499d20 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:34.004399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c5202713-277f-4eba-969f-6b69b6499d20 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:34.005029 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c5202713-277f-4eba-969f-6b69b6499d20 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:34.005571 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c5202713-277f-4eba-969f-6b69b6499d20 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:34.291278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c5202713-277f-4eba-969f-6b69b6499d20 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419319 Nov 02 12:59:34.291902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 357/737] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 12:59:33 2022] POST /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:41.898047 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:41.898972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:41.905703 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:41.906145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:41.906900 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:41.907335 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:41.931077 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lazy-loading 'flavor' on Instance uuid 8ddf14ef-eff5-4de1-b925-5be7a93bd241 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 12:59:42.069810 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-920393b9-e8dd-4200-8ce4-1458f5ac8936 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/action" status: 200 len: 32 microversion: 2.1 time: 0.175680 Nov 02 12:59:42.070438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 381/738] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:59:41 2022] POST /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:59:42.081444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:42.082166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:42.088697 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:42.089156 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:42.090170 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:42.090609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:42.346154 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:42.354867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fa180fc5-a50b-4f8d-adcb-541b3d763cd3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.278354 Nov 02 12:59:42.355452 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 358/739] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:42 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:43.379557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:43.380252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:43.386899 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:43.387339 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:43.388110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:43.388568 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:43.534974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:43.543598 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-26575d73-9ff6-400d-9e2d-4acd45ca5641 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.168271 Nov 02 12:59:43.544184 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 382/740] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:43 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:44.568982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:44.569589 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:44.576651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:44.577109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:44.577936 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:44.578370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:44.713453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:44.721927 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-825b07e5-2f9c-4ff9-acf4-7d35d924f2a8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.157000 Nov 02 12:59:44.722502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 359/741] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:44 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:45.748920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:45.749804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:45.759563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:45.760306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:45.761541 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:45.762203 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:45.906715 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:45.915265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d3cb1cee-c128-4ccd-9154-4dda2944d94b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.172906 Nov 02 12:59:45.915865 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 383/742] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:45 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:46.941077 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:46.941769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:46.948532 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:46.948986 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:46.949757 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:46.950192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:47.107035 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:47.115658 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2c099c76-ac02-40f4-a7d5-de27d6a65c13 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.179446 Nov 02 12:59:47.116230 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 360/743] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:46 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:48.149286 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:48.149922 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:48.156948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:48.157419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:48.158291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:48.158706 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:48.306474 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:48.314858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ea94b01b-ac8e-41f2-801f-bfe8f977a506 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.169591 Nov 02 12:59:48.315506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 384/744] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:48 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:49.342730 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:49.343362 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:49.352311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:49.352758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:49.353524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:49.353953 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:49.509216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:49.518822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0e09dfc3-e7a0-472e-aad5-7319bd478a44 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.182288 Nov 02 12:59:49.519410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 361/745] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:49 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:50.542857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:50.543460 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:50.550523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:50.550973 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:50.551750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:50.552183 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:50.687545 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:50.695998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0c092ce5-f5da-40b1-b46c-effc793e02a6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.157113 Nov 02 12:59:50.696600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 385/746] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:50 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:51.726026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:51.726896 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:51.737924 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:51.738372 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:51.739153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:51.739582 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:51.898062 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:51.906323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c233092b-f933-40ab-81a0-497539a3c815 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.187358 Nov 02 12:59:51.907105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 362/747] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:51 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:52.940678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:52.943228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:52.948548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:52.949004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:52.949777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:52.950186 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:53.109314 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:53.118682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ad7c15fa-f4df-46dd-8d79-3b121c14b7f2 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.184562 Nov 02 12:59:53.119351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 386/748] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:52 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:54.144463 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:54.145095 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:54.151942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:54.152427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:54.153199 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:54.153627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:54.299859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:54.310446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ee872735-aa8e-48ea-a87c-017b4427a293 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.169975 Nov 02 12:59:54.311389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 363/749] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:54 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:55.335549 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:55.336179 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:55.343204 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:55.343676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:55.344500 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:55.344927 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:55.505326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:55.514267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-422db6f2-5ecb-4d23-a3dc-5a8d4cd26046 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.182524 Nov 02 12:59:55.514839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 387/750] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:55 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:56.538860 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:56.539459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:56.546337 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:56.546785 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:56.547555 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:56.548001 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:56.686267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:56.696058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b58c1e53-596f-4224-9b37-14ef71473cc8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1735 microversion: 2.1 time: 0.161334 Nov 02 12:59:56.696687 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 364/751] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:56 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:57.721764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:57.722482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:57.730860 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:57.731566 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:57.732644 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:57.733226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:57.890394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:57.905461 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7b87cec9-218f-480b-8444-a4852e7f2e48 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1715 microversion: 2.1 time: 0.188971 Nov 02 12:59:57.906530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 388/752] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:57 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1715 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:57.981839 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:57.982344 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:57.991796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:57.992492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:57.993648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:57.994273 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:58.087505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] HTTP exception thrown: Cannot 'detach_volume' instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 while it is in vm_state rescued Nov 02 12:59:58.088100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Returning 409 to user: Cannot 'detach_volume' instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 while it is in vm_state rescued {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 12:59:58.088964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-27f3b8e8-7c40-4f86-b10c-ecf30031cefe tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments/4a5560e6-5492-40bc-abb6-b19e22cecbdd" status: 409 len: 152 microversion: 2.1 time: 0.113829 Nov 02 12:59:58.089525 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 365/753] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 12:59:57 2022] DELETE /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments/4a5560e6-5492-40bc-abb6-b19e22cecbdd => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:59:58.100342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-424ffbac-8c74-43b2-b451-16db7d23d29b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:58.100877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-424ffbac-8c74-43b2-b451-16db7d23d29b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:58.107636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-424ffbac-8c74-43b2-b451-16db7d23d29b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:58.108083 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-424ffbac-8c74-43b2-b451-16db7d23d29b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:58.108930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-424ffbac-8c74-43b2-b451-16db7d23d29b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:58.109364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-424ffbac-8c74-43b2-b451-16db7d23d29b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:58.192013 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-424ffbac-8c74-43b2-b451-16db7d23d29b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "POST /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/action" status: 202 len: 0 microversion: 2.1 time: 0.095815 Nov 02 12:59:58.192672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 389/754] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 12:59:58 2022] POST /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:59:58.201138 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:58.201747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:58.208839 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:58.209456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:58.210416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:58.210900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:58.438168 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:58.446882 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-265e2957-d163-428a-beaf-458faba392de tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1723 microversion: 2.1 time: 0.249596 Nov 02 12:59:58.448007 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 366/755] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:58 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:59.472530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:59.473200 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 12:59:59.481521 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:59.481993 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:59.482770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 12:59:59.483210 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 12:59:59.625633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:59.634686 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f17bbd02-a1dc-4ca6-a327-17d77c526b99 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1723 microversion: 2.1 time: 0.167274 Nov 02 12:59:59.635463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 390/756] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:59 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:00.662627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:00.663522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:00.674520 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:00.674991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:00.675764 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:00.676227 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:00.833358 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:00.845603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-36787c5a-2c22-4b09-b17f-bdcc8985eb3a tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1723 microversion: 2.1 time: 0.189621 Nov 02 13:00:00.846381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 367/757] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:00 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:01.875303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:01.875885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:01.883225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:01.883679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:01.884477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:01.884909 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:02.029284 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:02.038270 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cf74c1a4-d78a-4839-92b9-47a26f7221eb tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1723 microversion: 2.1 time: 0.167099 Nov 02 13:00:02.038866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 391/758] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:01 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:03.064952 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:03.065706 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:03.075946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:03.076722 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:03.077654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:03.078193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:03.259123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:03.267746 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-780c83e5-c8c4-401f-97a4-7f5f1fa04831 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1729 microversion: 2.1 time: 0.209239 Nov 02 13:00:03.268369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 368/759] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:03 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:03.291238 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-031261b4-46e5-440e-b2b6-b97f5e7f9d28 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:03.291767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-031261b4-46e5-440e-b2b6-b97f5e7f9d28 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:03.298802 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-031261b4-46e5-440e-b2b6-b97f5e7f9d28 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:03.299253 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-031261b4-46e5-440e-b2b6-b97f5e7f9d28 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:03.300057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-031261b4-46e5-440e-b2b6-b97f5e7f9d28 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:03.300530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-031261b4-46e5-440e-b2b6-b97f5e7f9d28 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:03.387335 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-031261b4-46e5-440e-b2b6-b97f5e7f9d28 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099955 Nov 02 13:00:03.387938 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 392/760] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 13:00:03 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:04.348048 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-20694fa8-594a-470e-9133-c166eabb330f req-f4139b35-027f-4e68-997e-2c87ce76bb47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddf14ef-eff5-4de1-b925-5be7a93bd241", "tag": "ae508632-412e-4df0-bb2e-e258d1a95cfa"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:04.356484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-20694fa8-594a-470e-9133-c166eabb330f req-f4139b35-027f-4e68-997e-2c87ce76bb47 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:04.356941 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-20694fa8-594a-470e-9133-c166eabb330f req-f4139b35-027f-4e68-997e-2c87ce76bb47 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:04.368595 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-20694fa8-594a-470e-9133-c166eabb330f req-f4139b35-027f-4e68-997e-2c87ce76bb47 service nova] Creating event network-changed:ae508632-412e-4df0-bb2e-e258d1a95cfa for instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 on hv-cinder-86327 Nov 02 13:00:04.373794 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-20694fa8-594a-470e-9133-c166eabb330f req-f4139b35-027f-4e68-997e-2c87ce76bb47 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086745 Nov 02 13:00:04.374619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 369/761] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:00:06.395281 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-8c1bfeed-4ef0-49fc-abce-3cd4a6103b9d req-1429edf3-2847-4928-826d-5402a1622b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ddf14ef-eff5-4de1-b925-5be7a93bd241", "tag": "ae508632-412e-4df0-bb2e-e258d1a95cfa"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:06.409287 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-8c1bfeed-4ef0-49fc-abce-3cd4a6103b9d req-1429edf3-2847-4928-826d-5402a1622b60 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:06.409701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-8c1bfeed-4ef0-49fc-abce-3cd4a6103b9d req-1429edf3-2847-4928-826d-5402a1622b60 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:06.421405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-8c1bfeed-4ef0-49fc-abce-3cd4a6103b9d req-1429edf3-2847-4928-826d-5402a1622b60 service nova] Creating event network-changed:ae508632-412e-4df0-bb2e-e258d1a95cfa for instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 on hv-cinder-86327 Nov 02 13:00:06.426847 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-8c1bfeed-4ef0-49fc-abce-3cd4a6103b9d req-1429edf3-2847-4928-826d-5402a1622b60 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039035 Nov 02 13:00:06.427430 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 393/762] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:10.911422 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:10.912046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:10.918926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:10.919380 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:10.920158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:10.920625 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:11.009028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lazy-loading 'services' on Instance uuid ebe9d261-592b-4b69-944d-5517465f6c40 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:00:11.085566 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d7fd468b-799e-4467-bbb7-b0b8d6a42ffc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-volume_attachments/7207c60a-9882-4554-b1f6-39c1bfb94156" status: 202 len: 0 microversion: 2.1 time: 0.182335 Nov 02 13:00:11.086554 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 370/763] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:00:10 2022] DELETE /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-volume_attachments/7207c60a-9882-4554-b1f6-39c1bfb94156 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:00:13.298394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-abdbf044-982c-4183-8aa7-ed0c607d6974 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:13.307318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-abdbf044-982c-4183-8aa7-ed0c607d6974 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:13.307996 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-abdbf044-982c-4183-8aa7-ed0c607d6974 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:13.372833 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-abdbf044-982c-4183-8aa7-ed0c607d6974 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Going to try to stop instance {{(pid=124277) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Nov 02 13:00:13.429523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-abdbf044-982c-4183-8aa7-ed0c607d6974 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action" status: 202 len: 0 microversion: 2.1 time: 0.138357 Nov 02 13:00:13.430163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 394/764] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 13:00:13 2022] POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:00:13.440277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:13.441025 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:13.448627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:13.449151 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:13.449964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:13.450400 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:13.600256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:13.607943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-372ad64b-b0f7-4254-84fb-782b5ed21787 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.172496 Nov 02 13:00:13.608563 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 371/765] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:13 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:14.634538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:14.635289 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:14.643519 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:14.643936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:14.644820 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:14.645317 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:14.789670 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:14.801317 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a04f5ebf-c077-4bf1-ac92-9750c4875776 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.171830 Nov 02 13:00:14.802166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 395/766] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:14 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:15.827068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:15.827783 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:15.835496 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:15.835948 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:15.836795 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:15.837196 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:16.156543 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:16.166642 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8da8f781-a328-4093-b45f-2b62798c859e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.344214 Nov 02 13:00:16.167359 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 372/767] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:15 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:17.201189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:17.202139 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:17.212119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:17.212605 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:17.213437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:17.213866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:17.366666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:17.377546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-07013731-097d-4243-85a5-b46a5bc9d1e0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.182724 Nov 02 13:00:17.378297 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 396/768] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:17 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:18.406827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:18.407464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:18.414291 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:18.414754 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:18.415535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:18.415969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:18.560805 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:18.572146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5df5b96b-1859-44e8-adc7-c9ba87621257 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.168993 Nov 02 13:00:18.573001 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 373/769] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:18 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:19.609679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:19.610335 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:19.620435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:19.621026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:19.622132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:19.622721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:19.773001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:19.784389 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8f1b4399-77fd-40ac-b406-0afe1825eed9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.180650 Nov 02 13:00:19.784959 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 397/770] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:19 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:20.808292 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:20.808902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:20.816027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:20.816537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:20.817429 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:20.817872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:20.964799 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:20.972893 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b3a3ff88-fac6-42bf-a20d-1f876f5ac6b1 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.168633 Nov 02 13:00:20.973492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 374/771] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:20 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:22.003397 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:22.004050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:22.010671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:22.011116 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:22.011891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:22.012350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:22.172543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:22.180789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cdc3f5af-b709-45ec-a0ae-78ef3e06ea75 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.185221 Nov 02 13:00:22.181362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 398/772] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:21 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:23.208110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:23.208990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:23.219109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:23.219784 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:23.221126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:23.221686 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:23.372936 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:23.381145 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-74194169-7980-46c9-835c-344f7c14feda tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1676 microversion: 2.1 time: 0.179071 Nov 02 13:00:23.381717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 375/773] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:23 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:24.405374 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:24.406016 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:24.412955 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:24.413413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:24.414195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:24.414626 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:24.564956 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:24.577409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c68dbb88-548d-4401-94ea-832a9f313c63 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1653 microversion: 2.1 time: 0.175764 Nov 02 13:00:24.578443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 399/774] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:24 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1653 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:24.602724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-98307b20-1f1e-43e8-b8da-784dbef98d74 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:24.609760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98307b20-1f1e-43e8-b8da-784dbef98d74 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:24.610210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-98307b20-1f1e-43e8-b8da-784dbef98d74 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:24.633501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-98307b20-1f1e-43e8-b8da-784dbef98d74 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Going to try to start instance {{(pid=124278) start /opt/stack/nova/nova/compute/api.py:2730}} Nov 02 13:00:24.679064 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-98307b20-1f1e-43e8-b8da-784dbef98d74 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action" status: 202 len: 0 microversion: 2.1 time: 0.080321 Nov 02 13:00:24.679738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 376/775] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 13:00:24 2022] POST /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:00:24.688393 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:24.689096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:24.695707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:24.696103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:24.697172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:24.697710 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:24.844990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:24.852916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-18cdf677-fca3-4aeb-b277-6396afafb094 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1662 microversion: 2.1 time: 0.168575 Nov 02 13:00:24.853677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 400/776] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:24 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:25.878644 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:25.879216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:25.885631 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:25.886085 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:25.886866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:25.887292 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:26.033609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:26.046603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7954c8d7-5df0-42f3-ae30-b2c67283736c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1662 microversion: 2.1 time: 0.172706 Nov 02 13:00:26.047369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 377/777] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:25 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:27.075257 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:27.076050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:27.084982 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:27.085578 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:27.086597 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:27.087182 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:27.243965 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:27.252461 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1004d823-831b-4dec-826f-3deabb853143 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1666 microversion: 2.1 time: 0.182269 Nov 02 13:00:27.253271 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 401/778] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:27 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:35.649090 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:35.649609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:35.656009 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:35.656528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:35.657304 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:35.657739 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:35.684321 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:00:35.764183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1c44366f-df1c-4dbb-b595-8d6d361390f6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "DELETE /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 204 len: 0 microversion: 2.1 time: 0.244283 Nov 02 13:00:35.764793 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 378/779] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:00:35 2022] DELETE /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:00:35.773642 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:35.774246 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:35.781336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:35.781782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:35.782537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:35.782964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:35.940308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:35.947904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-104d07df-6639-491f-9755-c167fbe68e44 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1577 microversion: 2.1 time: 0.178318 Nov 02 13:00:35.948511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 402/780] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:35 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:36.976958 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:36.978101 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:36.986569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:36.987004 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:36.987770 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:36.988234 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:37.139188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:37.147460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-006a261e-8c40-4ea2-835d-beeb0cdee529 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1577 microversion: 2.1 time: 0.177770 Nov 02 13:00:37.148034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 379/781] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:36 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:38.173977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:38.174610 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:38.184175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:38.184901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:38.186026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:38.186463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:38.341483 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:38.353804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-49416a14-9f26-468a-a136-124452e736b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1577 microversion: 2.1 time: 0.185803 Nov 02 13:00:38.354488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 403/782] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:38 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:39.378510 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:39.379143 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:39.386873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:39.387320 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:39.388735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:39.389303 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:39.608116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:39.616849 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-48f9adea-4a37-4572-a74b-3df0a3eff4cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1577 microversion: 2.1 time: 0.242772 Nov 02 13:00:39.632305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 380/783] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:39 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:39.915770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e793254e-91f7-46ff-8a1e-03a36b42dc7a req-ea62d804-c622-4a69-bcf9-15c8f6d974e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88552fef-2b2e-4ddf-bde5-ef27eeb43214", "name": "network-vif-deleted", "tag": "38d92677-8f89-4c4b-a02f-8a041e0b5b53"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:39.926305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e793254e-91f7-46ff-8a1e-03a36b42dc7a req-ea62d804-c622-4a69-bcf9-15c8f6d974e7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:39.927032 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e793254e-91f7-46ff-8a1e-03a36b42dc7a req-ea62d804-c622-4a69-bcf9-15c8f6d974e7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:39.938553 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e793254e-91f7-46ff-8a1e-03a36b42dc7a req-ea62d804-c622-4a69-bcf9-15c8f6d974e7 service nova] Creating event network-vif-deleted:38d92677-8f89-4c4b-a02f-8a041e0b5b53 for instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 on hv-cinder-86327 Nov 02 13:00:39.943823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e793254e-91f7-46ff-8a1e-03a36b42dc7a req-ea62d804-c622-4a69-bcf9-15c8f6d974e7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031770 Nov 02 13:00:39.947622 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 404/784] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:40.644116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:40.644871 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:40.651180 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:40.651627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:40.652447 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:40.652878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:40.683792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:40.684276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:40.684900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lazy-loading 'fault' on Instance uuid 88552fef-2b2e-4ddf-bde5-ef27eeb43214 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:00:40.731840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:40.740965 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-16e99710-9f56-4dcc-acbb-e85892e6e110 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 200 len: 1230 microversion: 2.1 time: 0.102494 Nov 02 13:00:40.741552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 381/785] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:40 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:41.766560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:41.767151 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:41.774252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:41.774695 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:41.775475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:41.775915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:41.791374 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] HTTP exception thrown: Instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 could not be found. Nov 02 13:00:41.791992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Returning 404 to user: Instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:00:41.792863 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5c2c7d3c-453c-4191-a089-39c79f269f4e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 404 len: 111 microversion: 2.1 time: 0.031493 Nov 02 13:00:41.793429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 405/786] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:41 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:00:41.907966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1562678254", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2037140484", "security_groups": [{"name": "tempest-secgroup-smoke-994655925"}], "block_device_mapping_v2": [{"uuid": "fb8a193a-9472-4df5-85d1-153f91a74dcc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dc24f821-79ec-4404-92fe-d5786cb39ed4"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:42.022716 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] validate_networks() for [('dc24f821-79ec-4404-92fe-d5786cb39ed4', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:00:42.466389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:00:42.466830 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:00:42.467623 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:00:42.468109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:00:42.468603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:00:42.478504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:42.478961 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:42.479757 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:42.480223 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:42.497752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:00:42.502519 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for user 8c01ed6e76ef4ee4ba5356c526e113e4 and project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:00:42.561098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:00:42.563353 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb8a193a-9472-4df5-85d1-153f91a74dcc',volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:00:42.693861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [4c5994b3-d40f-49e0-94d3-1e938a9af31e] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:00:43.704664 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [4c5994b3-d40f-49e0-94d3-1e938a9af31e] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 33828. Nov 02 13:00:43.709034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7e63e61d-ff77-4532-8eb6-70aec0451578 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.805418 Nov 02 13:00:43.709705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 382/787] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:00:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:00:43.722015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-07e44460-62bb-4fcb-9086-5ea10a3d5d63 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:43.722573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-07e44460-62bb-4fcb-9086-5ea10a3d5d63 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:43.780581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-07e44460-62bb-4fcb-9086-5ea10a3d5d63 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:43.787946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-07e44460-62bb-4fcb-9086-5ea10a3d5d63 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1095 microversion: 2.1 time: 0.070080 Nov 02 13:00:43.788608 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 406/788] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:43 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:44.814507 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:44.815451 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:44.821839 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:44.822323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:44.823191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:44.823749 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:44.891786 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:44.900642 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0a08b38a-a28b-4148-8897-7c283961eaae tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1193 microversion: 2.1 time: 0.092396 Nov 02 13:00:44.901244 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 383/789] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:44 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:45.927881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:45.928674 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:45.936138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:45.936615 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:45.937448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:45.937920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:46.076542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:46.085439 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-061cc006-63bb-4716-be8f-9f8ef2c15c8b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1278 microversion: 2.1 time: 0.164308 Nov 02 13:00:46.086104 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 407/790] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:45 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:46.318621 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d1a3f08a-c63d-41c8-a85d-f7b54231717b req-fb15d6da-cd90-4d09-ae22-dee6f2ec4bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3a70f5-7a54-4a66-b099-dcf84affc11d", "tag": "9ee660ea-c2fa-4fab-a75e-65370edd6b07"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:46.328271 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d1a3f08a-c63d-41c8-a85d-f7b54231717b req-fb15d6da-cd90-4d09-ae22-dee6f2ec4bde service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:46.329106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d1a3f08a-c63d-41c8-a85d-f7b54231717b req-fb15d6da-cd90-4d09-ae22-dee6f2ec4bde service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:46.343433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d1a3f08a-c63d-41c8-a85d-f7b54231717b req-fb15d6da-cd90-4d09-ae22-dee6f2ec4bde service nova] Creating event network-changed:9ee660ea-c2fa-4fab-a75e-65370edd6b07 for instance ed3a70f5-7a54-4a66-b099-dcf84affc11d on hv-cinder-86327 Nov 02 13:00:46.348506 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d1a3f08a-c63d-41c8-a85d-f7b54231717b req-fb15d6da-cd90-4d09-ae22-dee6f2ec4bde service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033855 Nov 02 13:00:46.349127 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 384/791] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:47.108824 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:47.109513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:47.116529 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:47.117006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:47.117811 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:47.118240 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:47.256558 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:47.264666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-34b7ab76-bdd7-4935-b801-ff9b789d3131 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.159742 Nov 02 13:00:47.265463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 408/792] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:47 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:48.293972 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:48.294890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:48.303022 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:48.303492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:48.304260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:48.304728 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:48.455628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:48.464713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-105846ca-5980-44e8-812a-2f6957280f56 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.178857 Nov 02 13:00:48.465281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 385/793] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:48 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:49.345544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6f1085ad-18e1-42a4-bffb-1694cbe332c3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:49.346140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6f1085ad-18e1-42a4-bffb-1694cbe332c3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:49.352852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f1085ad-18e1-42a4-bffb-1694cbe332c3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.353299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f1085ad-18e1-42a4-bffb-1694cbe332c3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.354057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f1085ad-18e1-42a4-bffb-1694cbe332c3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.354497 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f1085ad-18e1-42a4-bffb-1694cbe332c3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.383496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6f1085ad-18e1-42a4-bffb-1694cbe332c3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments/34a5d42c-e4fb-40e5-b6c7-0cb98fe35105" status: 200 len: 194 microversion: 2.20 time: 0.043794 Nov 02 13:00:49.384076 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 409/794] 10.222.0.90 () {60 vars in 1454 bytes} [Wed Nov 2 13:00:49 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments/34a5d42c-e4fb-40e5-b6c7-0cb98fe35105 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:00:49.455259 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:49.455879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:49.462233 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.462684 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.463453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.463889 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.488600 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:49.489222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:49.496617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.497062 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.497852 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.498282 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.548857 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lazy-loading 'services' on Instance uuid 1839881d-97b0-4aa7-b398-2eeee344099f {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:00:49.622279 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2d3f385f-7758-4958-b1ef-690e87db8b36 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments/34a5d42c-e4fb-40e5-b6c7-0cb98fe35105" status: 202 len: 0 microversion: 2.20 time: 0.171012 Nov 02 13:00:49.623246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 386/795] 10.222.0.90 () {60 vars in 1457 bytes} [Wed Nov 2 13:00:49 2022] DELETE /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments/34a5d42c-e4fb-40e5-b6c7-0cb98fe35105 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:00:49.639512 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bb80a189-0d8f-49e4-a6f3-bc9f7aeacde3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:49.641307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bb80a189-0d8f-49e4-a6f3-bc9f7aeacde3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:49.650007 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb80a189-0d8f-49e4-a6f3-bc9f7aeacde3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.650276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:49.650473 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb80a189-0d8f-49e4-a6f3-bc9f7aeacde3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.651290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb80a189-0d8f-49e4-a6f3-bc9f7aeacde3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:49.651697 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb80a189-0d8f-49e4-a6f3-bc9f7aeacde3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:49.658396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3644db11-27de-49aa-9faf-b3040b4a5e67 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.174034 Nov 02 13:00:49.659005 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 410/796] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:49 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:49.684021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bb80a189-0d8f-49e4-a6f3-bc9f7aeacde3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055946 Nov 02 13:00:49.689126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 387/797] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Nov 2 13:00:49 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:00:50.684435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:50.685061 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:50.692385 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.692854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:50.693632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.694074 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:50.697420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-84c15270-e44f-4d3d-98f3-69b5a3521983 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:50.698455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-84c15270-e44f-4d3d-98f3-69b5a3521983 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:50.706454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c15270-e44f-4d3d-98f3-69b5a3521983 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.706900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c15270-e44f-4d3d-98f3-69b5a3521983 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:50.707673 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c15270-e44f-4d3d-98f3-69b5a3521983 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.708090 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-84c15270-e44f-4d3d-98f3-69b5a3521983 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:50.739014 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-84c15270-e44f-4d3d-98f3-69b5a3521983 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045726 Nov 02 13:00:50.739918 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 388/798] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Nov 2 13:00:50 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:50.806268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:50.806762 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:50.813053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.813512 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:50.814490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.815019 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:50.839124 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:00:50.846116 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:50.853487 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a504817d-533d-4b26-8e8b-ffb37f532fc7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.174628 Nov 02 13:00:50.854047 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 411/799] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:50 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:50.932917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0f24c825-d81b-4cd4-8e6e-246044756581 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 204 len: 0 microversion: 2.20 time: 0.130463 Nov 02 13:00:50.933552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 389/800] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Nov 2 13:00:50 2022] DELETE /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:00:50.942513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:50.943128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:50.949392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.949836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:50.950627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:50.951055 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:51.104713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:51.115769 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:51.117298 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:51.118698 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cfcdc087-63da-4474-8cd4-2c606a02c398 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.180375 Nov 02 13:00:51.119270 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 412/801] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:00:50 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:00:51.882776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:51.883662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:51.893679 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:51.894122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:51.894899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:51.895326 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:52.038847 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:52.046738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fabdc001-b531-405d-a3b4-0b9c013d3018 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.171685 Nov 02 13:00:52.047451 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 390/802] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:51 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:52.148388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:52.149259 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:52.158151 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:52.158601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:52.159372 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:52.159798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:52.317943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:52.329554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:52.331928 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:52.333721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7336ef90-4ed8-4897-94ee-66c24e92101f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.191060 Nov 02 13:00:52.334490 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 413/803] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:00:52 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:00:53.081737 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:53.082540 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:53.090356 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:53.090921 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:53.091878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:53.092512 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:53.238956 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:53.250714 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-99a59051-8d0c-48f9-bf77-c8f584aeecab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.174529 Nov 02 13:00:53.251656 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 391/804] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:53 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:53.364314 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:53.364898 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:53.371006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:53.371556 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:53.372451 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:53.372886 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:53.511646 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:53.520542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:53.522046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:53.523250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b686f75e-0132-482d-9b73-5f21d61e0796 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1724 microversion: 2.20 time: 0.164184 Nov 02 13:00:53.523828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 414/805] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:00:53 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:00:54.172892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-8b30499e-3ec9-4c14-b9ad-3fd03e14ba83 req-947e22ed-a7fe-4041-b97f-a65ba3871369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1839881d-97b0-4aa7-b398-2eeee344099f", "name": "network-vif-deleted", "tag": "7a7f193c-8f61-4df5-8e3c-0d69f95daa2f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:54.182053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8b30499e-3ec9-4c14-b9ad-3fd03e14ba83 req-947e22ed-a7fe-4041-b97f-a65ba3871369 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:54.182498 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8b30499e-3ec9-4c14-b9ad-3fd03e14ba83 req-947e22ed-a7fe-4041-b97f-a65ba3871369 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:54.194348 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-8b30499e-3ec9-4c14-b9ad-3fd03e14ba83 req-947e22ed-a7fe-4041-b97f-a65ba3871369 service nova] Creating event network-vif-deleted:7a7f193c-8f61-4df5-8e3c-0d69f95daa2f for instance 1839881d-97b0-4aa7-b398-2eeee344099f on hv-cinder-86327 Nov 02 13:00:54.199484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-8b30499e-3ec9-4c14-b9ad-3fd03e14ba83 req-947e22ed-a7fe-4041-b97f-a65ba3871369 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Nov 02 13:00:54.200314 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 392/806] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:54.282080 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:54.283084 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:54.289723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:54.290506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:54.291578 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:54.292302 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:54.452134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:54.460652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ec39efa1-6131-47ac-a1ed-6d77846564cd tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.188694 Nov 02 13:00:54.461267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 415/807] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:54 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:54.551026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:54.551715 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:54.559254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:54.559698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:54.560470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:54.560908 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:54.594237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:54.594237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:54.594691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lazy-loading 'fault' on Instance uuid 1839881d-97b0-4aa7-b398-2eeee344099f {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:00:54.640274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:54.648431 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:54.649932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:54.651129 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d360ee13-fcd1-4fd7-be7d-bbdbabee715f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 200 len: 1372 microversion: 2.20 time: 0.105042 Nov 02 13:00:54.651872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 393/808] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:00:54 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:00:55.487213 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:55.487784 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:55.494863 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:55.495315 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:55.496099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:55.496576 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:55.647594 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:55.659440 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f94f69f1-c571-4a81-ab84-d8bc7cf94931 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.177398 Nov 02 13:00:55.660341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 416/809] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:55 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:55.679261 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:55.680153 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:55.687533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:55.687984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:55.689051 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:55.689409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:55.704434 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] HTTP exception thrown: Instance 1839881d-97b0-4aa7-b398-2eeee344099f could not be found. Nov 02 13:00:55.704983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Returning 404 to user: Instance 1839881d-97b0-4aa7-b398-2eeee344099f could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:00:55.705835 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-62e743ce-72a9-41a5-a212-66fe47eee807 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 404 len: 111 microversion: 2.20 time: 0.032152 Nov 02 13:00:55.706375 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 394/810] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:00:55 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:00:55.717523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ff0a94b5-f675-42db-8005-402960abaf93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '.version_select at 0x7fbe41db83a0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:55.722006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff0a94b5-f675-42db-8005-402960abaf93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [492d1a16-92bf-4874-9a92-98f1cec77b2b] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:00:56.688720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:56.689319 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:56.696043 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:56.696538 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:56.697324 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:56.697758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:56.731535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff0a94b5-f675-42db-8005-402960abaf93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [492d1a16-92bf-4874-9a92-98f1cec77b2b] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 33906. Nov 02 13:00:56.756777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ff0a94b5-f675-42db-8005-402960abaf93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258155672" status: 204 len: 0 microversion: 2.20 time: 1.044890 Nov 02 13:00:56.757376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 417/811] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Nov 2 13:00:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258155672 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:00:56.848079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:56.855963 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ed37f3a5-79aa-48d7-a693-afe2111d5e2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.171604 Nov 02 13:00:56.856631 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 395/812] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:56 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:57.688153 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-da377d58-63f3-4c25-b5f1-11abc623a656 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'create', calling method: .version_select at 0x7fbe41db2940>, body: {"keypair": {"name": "tempest-keypair-46503764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3oogiejL94VEdZvTL4Yc2X2H/fFswoxEoqG9P4gQane7dcwoy/NN4VsQx3KAWercnrYkMU9P5UaAl7EwfFtx1yM9x/BUPifW++fjWXCBwfXu+DfyqhcOc1psQZWkuh3g=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:57.707010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-da377d58-63f3-4c25-b5f1-11abc623a656 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:00:57.711381 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-da377d58-63f3-4c25-b5f1-11abc623a656 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for user a2c786462bac45848eeff3a966e71149 and project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:00:57.741297 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-da377d58-63f3-4c25-b5f1-11abc623a656 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.059642 Nov 02 13:00:57.742110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 418/813] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Nov 2 13:00:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:00:57.881776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:57.882437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:57.891047 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:57.891838 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:57.892772 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:57.893237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:58.124144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:58.132576 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1355bb04-c5f0-4201-b061-7cafd591a564 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.257038 Nov 02 13:00:58.133155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 396/814] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:57 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:59.157301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:59.158544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:59.165891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:59.166345 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:59.167146 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:59.167526 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:59.173738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1973181832", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c790846-1155-4e44-80f1-15983b65a735"}], "security_groups": [{"name": "tempest-securitygroup--773433247"}], "key_name": "tempest-keypair-46503764", "user_data": "}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:59.284748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] validate_networks() for [('5c790846-1155-4e44-80f1-15983b65a735', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:00:59.316124 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:59.324110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-77cedde5-ee14-4f40-935b-f22b30d237c4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.171260 Nov 02 13:00:59.337648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:00:59.338074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Nov 02 13:00:59.340729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 419/815] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:59 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:59.347196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-48892beb-dcb0-42b0-bd49-47109ddc6fc2 req-481beb6f-7c0c-4173-8aff-63770edadaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3a70f5-7a54-4a66-b099-dcf84affc11d", "name": "network-vif-plugged", "status": "completed", "tag": "9ee660ea-c2fa-4fab-a75e-65370edd6b07"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:59.355466 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-48892beb-dcb0-42b0-bd49-47109ddc6fc2 req-481beb6f-7c0c-4173-8aff-63770edadaa7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:59.355990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-48892beb-dcb0-42b0-bd49-47109ddc6fc2 req-481beb6f-7c0c-4173-8aff-63770edadaa7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:59.368760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-48892beb-dcb0-42b0-bd49-47109ddc6fc2 req-481beb6f-7c0c-4173-8aff-63770edadaa7 service nova] Creating event network-vif-plugged:9ee660ea-c2fa-4fab-a75e-65370edd6b07 for instance ed3a70f5-7a54-4a66-b099-dcf84affc11d on hv-cinder-86327 Nov 02 13:00:59.376682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-48892beb-dcb0-42b0-bd49-47109ddc6fc2 req-481beb6f-7c0c-4173-8aff-63770edadaa7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033133 Nov 02 13:00:59.377609 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 420/816] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:59.711962 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:00:59.712426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:00:59.712899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:00:59.713302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:00:59.713709 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:00:59.723537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:59.723985 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:59.724843 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:00:59.725241 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:00:59.742999 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:00:59.747051 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Getting quotas for user a2c786462bac45848eeff3a966e71149 and project 7cf71ef682d140f9b9c9c756b24cbb5b. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:00:59.760083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:00:59.762923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:00:59.812165 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-364ea0c8-ad36-4942-ae65-a248284cb2c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.643135 Nov 02 13:00:59.812895 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 397/817] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Nov 2 13:00:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:00:59.824730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4373c028-026d-4a6a-b749-c4e6a4d7070b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:59.825419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4373c028-026d-4a6a-b749-c4e6a4d7070b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:00:59.883554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4373c028-026d-4a6a-b749-c4e6a4d7070b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:59.891214 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4373c028-026d-4a6a-b749-c4e6a4d7070b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:59.892738 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4373c028-026d-4a6a-b749-c4e6a4d7070b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:59.893853 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4373c028-026d-4a6a-b749-c4e6a4d7070b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1280 microversion: 2.20 time: 0.073424 Nov 02 13:00:59.894443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 421/818] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:00:59 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:00.349539 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:00.350383 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:00.357467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:00.357941 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:00.358708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:00.359166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:00.502306 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:00.512731 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7f607c80-45c9-4919-8374-878603115f43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.168404 Nov 02 13:01:00.513655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 398/819] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:00 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:00.919079 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:00.919776 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:00.926827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:00.927291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:00.928048 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:00.928515 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:00.996367 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:01.004924 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:01.006407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:01.007499 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a6395f0a-f99e-4bcd-90ab-bde8594d3f83 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1332 microversion: 2.20 time: 0.092536 Nov 02 13:01:01.008083 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 422/820] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:00 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:01.538114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:01.538914 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:01.547472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:01.548146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:01.549096 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:01.549603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:01.791489 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:01.800569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f8e37867-0bb7-4c00-bd10-c85801afae1a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1266 microversion: 2.1 time: 0.267654 Nov 02 13:01:01.801118 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 399/821] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:01 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:02.033392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:02.034003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:02.041258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:02.042076 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:02.043087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:02.043730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:02.182796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:02.192411 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:02.195054 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:02.196685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-79859af1-9c2c-44c9-8679-122b62e172b5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.166869 Nov 02 13:01:02.208526 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 423/822] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:02 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:02.580819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d381f59a-1f7b-4a8c-84b6-cbaa2ac2a40c req-12bcd04f-7cd4-4f31-ab12-f47d5b491f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cf2036-8434-479c-a251-9f6411e8062a", "tag": "d5aae24c-ac0a-4c55-b771-4ccad1cc65ab"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:02.591188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d381f59a-1f7b-4a8c-84b6-cbaa2ac2a40c req-12bcd04f-7cd4-4f31-ab12-f47d5b491f9c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:02.591750 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d381f59a-1f7b-4a8c-84b6-cbaa2ac2a40c req-12bcd04f-7cd4-4f31-ab12-f47d5b491f9c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:02.603914 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d381f59a-1f7b-4a8c-84b6-cbaa2ac2a40c req-12bcd04f-7cd4-4f31-ab12-f47d5b491f9c service nova] Creating event network-changed:d5aae24c-ac0a-4c55-b771-4ccad1cc65ab for instance 45cf2036-8434-479c-a251-9f6411e8062a on hv-cinder-86327 Nov 02 13:01:02.609067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d381f59a-1f7b-4a8c-84b6-cbaa2ac2a40c req-12bcd04f-7cd4-4f31-ab12-f47d5b491f9c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 Nov 02 13:01:02.609698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 400/823] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:02.823360 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:02.823999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:02.830168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:02.830616 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:02.831419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:02.831859 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:02.983752 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:02.991983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2a09c961-15fe-44ec-a619-db14e8d146d1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1454 microversion: 2.1 time: 0.172648 Nov 02 13:01:02.992594 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 424/824] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:02 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1454 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:03.015702 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:03.016703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:03.023109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:03.023566 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:03.024357 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:03.024790 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:03.204987 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:03.212935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-abad4ede-9197-4349-b956-7733988078b6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1454 microversion: 2.1 time: 0.202112 Nov 02 13:01:03.213503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 401/825] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:03 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1454 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:03.222658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:03.223277 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:03.230098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:03.230560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:03.231324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:03.231995 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:03.380503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:03.389577 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:03.391299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:03.392534 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-16b3afb4-565b-4fed-b696-a8ca33805788 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.174281 Nov 02 13:01:03.393181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 425/826] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:03 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:04.418658 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:04.419301 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:04.426926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:04.427446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:04.428335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:04.428943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:04.761572 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:04.771522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:04.773071 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:04.774197 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d10abf87-f5e5-40a2-9b3a-424a038e5638 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.359871 Nov 02 13:01:04.774783 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 402/827] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:04 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:05.442934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-51abcfa2-e5c8-4702-b53c-dd548aea5ec1 req-9b873e9f-ce5c-4114-ab0d-a07377f7b865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3a70f5-7a54-4a66-b099-dcf84affc11d", "tag": "9ee660ea-c2fa-4fab-a75e-65370edd6b07"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:05.452337 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-51abcfa2-e5c8-4702-b53c-dd548aea5ec1 req-9b873e9f-ce5c-4114-ab0d-a07377f7b865 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:05.452869 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-51abcfa2-e5c8-4702-b53c-dd548aea5ec1 req-9b873e9f-ce5c-4114-ab0d-a07377f7b865 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:05.464575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-51abcfa2-e5c8-4702-b53c-dd548aea5ec1 req-9b873e9f-ce5c-4114-ab0d-a07377f7b865 service nova] Creating event network-changed:9ee660ea-c2fa-4fab-a75e-65370edd6b07 for instance ed3a70f5-7a54-4a66-b099-dcf84affc11d on hv-cinder-86327 Nov 02 13:01:05.470390 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-51abcfa2-e5c8-4702-b53c-dd548aea5ec1 req-9b873e9f-ce5c-4114-ab0d-a07377f7b865 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031304 Nov 02 13:01:05.471113 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 426/828] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:05.800257 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:05.800803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:05.807186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:05.807946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:05.808994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:05.809588 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:06.081353 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:06.092047 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:06.094783 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:06.095913 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e8fe0bfa-0ab2-4760-983c-5978029f73f9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.300195 Nov 02 13:01:06.096683 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 403/829] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:05 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:07.124437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:07.125251 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:07.132533 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:07.132994 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:07.133775 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:07.134212 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:07.291004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:07.299728 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:07.301336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:07.302444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c0562e8a-3685-489a-ad61-ee637d3c28fa tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.183613 Nov 02 13:01:07.303022 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 427/830] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:07 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:08.330740 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:08.331745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:08.338743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:08.339202 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:08.339982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:08.340462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:08.493371 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:08.503598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:08.505345 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:08.506634 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b2996b40-0a37-46a8-8eee-72994ed6a6a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.182844 Nov 02 13:01:08.507298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 404/831] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:08 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:09.433232 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e3a98b6c-ee51-489c-819b-7cd331bea00f req-8f01e94b-2037-40ff-9854-78c1b3b71c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cf2036-8434-479c-a251-9f6411e8062a", "name": "network-vif-plugged", "status": "completed", "tag": "d5aae24c-ac0a-4c55-b771-4ccad1cc65ab"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:09.442836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e3a98b6c-ee51-489c-819b-7cd331bea00f req-8f01e94b-2037-40ff-9854-78c1b3b71c8f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:09.443371 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e3a98b6c-ee51-489c-819b-7cd331bea00f req-8f01e94b-2037-40ff-9854-78c1b3b71c8f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:09.455394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e3a98b6c-ee51-489c-819b-7cd331bea00f req-8f01e94b-2037-40ff-9854-78c1b3b71c8f service nova] Creating event network-vif-plugged:d5aae24c-ac0a-4c55-b771-4ccad1cc65ab for instance 45cf2036-8434-479c-a251-9f6411e8062a on hv-cinder-86327 Nov 02 13:01:09.464043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e3a98b6c-ee51-489c-819b-7cd331bea00f req-8f01e94b-2037-40ff-9854-78c1b3b71c8f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031491 Nov 02 13:01:09.464043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 428/832] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:09.528902 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:01:09.529184 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: Wed Nov 2 13:01:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:01:09.533940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:09.534653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:09.542356 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:09.542810 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:09.543588 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:09.544021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:09.710601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:09.718822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:09.720744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:09.722405 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f4ee7b24-be34-4adf-ba64-415c39c50827 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.193977 Nov 02 13:01:09.723252 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 405/833] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:09 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:10.752050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:10.752718 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:10.763281 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:10.763760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:10.764729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:10.765236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:10.916390 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:10.925420 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:10.926916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:10.928048 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b943ba3d-29b1-4aff-acab-8221750b0352 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1405 microversion: 2.20 time: 0.183652 Nov 02 13:01:10.928764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 429/834] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:10 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:11.957475 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:11.958302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:11.965483 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:11.965930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:11.966682 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:11.967107 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:12.116165 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:12.124169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:12.125675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:12.127104 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ed576f45-4b44-432f-a85d-b691095db212 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1598 microversion: 2.20 time: 0.175892 Nov 02 13:01:12.127666 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 406/835] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:01:11 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:01:12.152273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-75d19d81-3443-4df1-98e2-4baf6fdf3274 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:12.152814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-75d19d81-3443-4df1-98e2-4baf6fdf3274 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:12.159931 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d19d81-3443-4df1-98e2-4baf6fdf3274 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:12.160424 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d19d81-3443-4df1-98e2-4baf6fdf3274 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:12.161192 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d19d81-3443-4df1-98e2-4baf6fdf3274 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:12.161633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-75d19d81-3443-4df1-98e2-4baf6fdf3274 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:12.262130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-75d19d81-3443-4df1-98e2-4baf6fdf3274 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113409 Nov 02 13:01:12.263382 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 430/836] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Nov 2 13:01:12 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:01:13.248172 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-4198c211-95b1-45cd-895e-c2a5fc3519e6 req-434c0ab2-3e70-4563-aa03-85d9bf413aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cf2036-8434-479c-a251-9f6411e8062a", "tag": "d5aae24c-ac0a-4c55-b771-4ccad1cc65ab"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:13.257354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-4198c211-95b1-45cd-895e-c2a5fc3519e6 req-434c0ab2-3e70-4563-aa03-85d9bf413aed service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:13.257795 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-4198c211-95b1-45cd-895e-c2a5fc3519e6 req-434c0ab2-3e70-4563-aa03-85d9bf413aed service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:13.269693 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-4198c211-95b1-45cd-895e-c2a5fc3519e6 req-434c0ab2-3e70-4563-aa03-85d9bf413aed service nova] Creating event network-changed:d5aae24c-ac0a-4c55-b771-4ccad1cc65ab for instance 45cf2036-8434-479c-a251-9f6411e8062a on hv-cinder-86327 Nov 02 13:01:13.275704 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-4198c211-95b1-45cd-895e-c2a5fc3519e6 req-434c0ab2-3e70-4563-aa03-85d9bf413aed service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031231 Nov 02 13:01:13.276494 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 407/837] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:20.401229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:20.401817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:20.408588 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:20.409047 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:20.409884 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:20.410325 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:20.503789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lazy-loading 'services' on Instance uuid 8ddf14ef-eff5-4de1-b925-5be7a93bd241 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:01:20.585808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3742795b-d94c-4534-b282-423912ae9287 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments/4a5560e6-5492-40bc-abb6-b19e22cecbdd" status: 202 len: 0 microversion: 2.1 time: 0.189023 Nov 02 13:01:20.586505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 431/838] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:01:20 2022] DELETE /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments/4a5560e6-5492-40bc-abb6-b19e22cecbdd => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:01:20.596509 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2e74bcea-269d-46b5-ae54-cc5741d5b3c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:20.597612 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2e74bcea-269d-46b5-ae54-cc5741d5b3c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:20.607916 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e74bcea-269d-46b5-ae54-cc5741d5b3c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:20.609010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e74bcea-269d-46b5-ae54-cc5741d5b3c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:20.610152 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e74bcea-269d-46b5-ae54-cc5741d5b3c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:20.610900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e74bcea-269d-46b5-ae54-cc5741d5b3c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:20.644515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2e74bcea-269d-46b5-ae54-cc5741d5b3c8 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052717 Nov 02 13:01:20.645569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 408/839] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:01:20 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:01:21.660192 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-87448da7-3fa6-4172-9bd1-c919a6ad4406 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:21.661302 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-87448da7-3fa6-4172-9bd1-c919a6ad4406 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:21.668183 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87448da7-3fa6-4172-9bd1-c919a6ad4406 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:21.668656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87448da7-3fa6-4172-9bd1-c919a6ad4406 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:21.669435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87448da7-3fa6-4172-9bd1-c919a6ad4406 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:21.669865 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87448da7-3fa6-4172-9bd1-c919a6ad4406 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:21.700482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-87448da7-3fa6-4172-9bd1-c919a6ad4406 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Nov 02 13:01:21.701360 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 432/840] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:01:21 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:22.719274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-60f469ed-f09f-4bd7-a3b3-aa4f3d8c7d4b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:22.720194 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-60f469ed-f09f-4bd7-a3b3-aa4f3d8c7d4b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:22.729956 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60f469ed-f09f-4bd7-a3b3-aa4f3d8c7d4b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:22.730593 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60f469ed-f09f-4bd7-a3b3-aa4f3d8c7d4b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:22.731367 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60f469ed-f09f-4bd7-a3b3-aa4f3d8c7d4b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:22.731800 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60f469ed-f09f-4bd7-a3b3-aa4f3d8c7d4b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:22.764218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-60f469ed-f09f-4bd7-a3b3-aa4f3d8c7d4b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051683 Nov 02 13:01:22.764824 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 409/841] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:01:22 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:01:22.855825 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:22.856400 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:22.863729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:22.864182 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:22.864989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:22.865434 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:22.890939 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:01:22.986894 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-21cff0c3-3e53-4ae2-a3aa-4eb3a94b7916 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 204 len: 0 microversion: 2.1 time: 0.134712 Nov 02 13:01:22.987415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 433/842] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:22 2022] DELETE /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:22.995989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:22.996654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:23.002619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:23.003062 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:23.003819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:23.004269 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:23.146852 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:23.156537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bc03e6a0-3d74-4154-87e3-d679c36dd797 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1689 microversion: 2.1 time: 0.164555 Nov 02 13:01:23.157127 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 410/843] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:22 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:01:24.194688 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:24.195826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:24.204443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:24.204894 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:24.205691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:24.206132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:24.368959 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:24.377043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fbbf6ad8-961c-40e7-84bc-73285ba82765 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1689 microversion: 2.1 time: 0.189949 Nov 02 13:01:24.377617 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 434/844] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:24 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:25.407662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:25.408537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:25.419049 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:25.419784 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:25.421396 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:25.421767 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:25.580177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:25.592879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7a5a61a6-3d22-4b25-af73-fdec856aef73 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1689 microversion: 2.1 time: 0.191404 Nov 02 13:01:25.593463 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 411/845] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:25 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:26.621333 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:26.622239 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:26.633365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:26.634115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:26.635386 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:26.636097 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:26.793398 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:26.805364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a9ba1b2c-1bed-4611-9503-2feb98375c40 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1689 microversion: 2.1 time: 0.190896 Nov 02 13:01:26.805954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 435/846] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:26 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:27.829387 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:27.830015 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:27.837193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:27.837646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:27.838433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:27.838869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:28.249867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:28.261392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-88df81f0-073a-4a2c-967a-d983484d08bd tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 200 len: 1689 microversion: 2.1 time: 0.435678 Nov 02 13:01:28.262185 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 412/847] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:27 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 1689 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:28.490115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-7f8f7759-bb10-4539-b037-f3790a19b301 req-1dbcb03d-f215-4950-8eb9-cf400022854d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ddf14ef-eff5-4de1-b925-5be7a93bd241", "name": "network-vif-deleted", "tag": "ae508632-412e-4df0-bb2e-e258d1a95cfa"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:28.498835 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-7f8f7759-bb10-4539-b037-f3790a19b301 req-1dbcb03d-f215-4950-8eb9-cf400022854d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:28.499367 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-7f8f7759-bb10-4539-b037-f3790a19b301 req-1dbcb03d-f215-4950-8eb9-cf400022854d service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:28.515292 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-7f8f7759-bb10-4539-b037-f3790a19b301 req-1dbcb03d-f215-4950-8eb9-cf400022854d service nova] Creating event network-vif-deleted:ae508632-412e-4df0-bb2e-e258d1a95cfa for instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 on hv-cinder-86327 Nov 02 13:01:28.520568 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-7f8f7759-bb10-4539-b037-f3790a19b301 req-1dbcb03d-f215-4950-8eb9-cf400022854d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Nov 02 13:01:28.521732 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 436/848] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:29.290544 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:29.291131 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8ddf14ef-eff5-4de1-b925-5be7a93bd241] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:29.297844 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:29.298329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:29.299095 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:29.299542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:29.314852 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] HTTP exception thrown: Instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 could not be found. Nov 02 13:01:29.315370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Returning 404 to user: Instance 8ddf14ef-eff5-4de1-b925-5be7a93bd241 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:01:29.316298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e543118d-c7bc-44c2-b54d-3116bc618ac3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241" status: 404 len: 111 microversion: 2.1 time: 0.029835 Nov 02 13:01:29.316869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 413/849] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:29 2022] GET /compute/v2.1/servers/8ddf14ef-eff5-4de1-b925-5be7a93bd241 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:29.326304 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bfb8bbba-828a-46f3-b428-887937c991dc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '.version_select at 0x7fbe41ed31f0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:29.347490 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bfb8bbba-828a-46f3-b428-887937c991dc tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576174273" status: 202 len: 0 microversion: 2.1 time: 0.025559 Nov 02 13:01:29.348307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 437/850] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Nov 2 13:01:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576174273 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:01:32.506886 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:32.507442 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:32.514490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:32.514932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:32.515699 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:32.516301 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:32.542781 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:01:32.647167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5066487e-1d90-4bd0-b2db-9f21e8d00d6e tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 204 len: 0 microversion: 2.1 time: 0.144042 Nov 02 13:01:32.647689 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 414/851] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:32 2022] DELETE /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:32.656696 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:32.657437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:32.663825 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:32.664339 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:32.665110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:32.665546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:32.809587 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:32.820860 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-51fe398e-85ca-4bac-a0d6-0c3fb8b890e3 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1507 microversion: 2.1 time: 0.168485 Nov 02 13:01:32.821683 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 438/852] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:32 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:33.850060 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:33.850760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:33.857460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:33.857903 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:33.858795 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:33.859212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:34.092600 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:34.100730 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9f9b5a60-45ea-4dce-9170-d00bc5805b82 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 200 len: 1507 microversion: 2.1 time: 0.255091 Nov 02 13:01:34.101338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 415/853] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:33 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:34.234448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-288e2dd5-5380-4c13-984c-b885d28df18d req-1747846c-5f81-44d0-8431-5c9d5598f9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d458f0b-437a-41ff-93f3-1091857b39c8", "name": "network-vif-deleted", "tag": "ceff5860-04fb-4226-b8ae-37c3cb9c96be"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:34.243970 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-288e2dd5-5380-4c13-984c-b885d28df18d req-1747846c-5f81-44d0-8431-5c9d5598f9a8 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:34.244481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-288e2dd5-5380-4c13-984c-b885d28df18d req-1747846c-5f81-44d0-8431-5c9d5598f9a8 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:34.256167 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-288e2dd5-5380-4c13-984c-b885d28df18d req-1747846c-5f81-44d0-8431-5c9d5598f9a8 service nova] Creating event network-vif-deleted:ceff5860-04fb-4226-b8ae-37c3cb9c96be for instance 8d458f0b-437a-41ff-93f3-1091857b39c8 on hv-cinder-86327 Nov 02 13:01:34.261019 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-288e2dd5-5380-4c13-984c-b885d28df18d req-1747846c-5f81-44d0-8431-5c9d5598f9a8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Nov 02 13:01:34.261967 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 439/854] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:35.128344 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:35.128932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 8d458f0b-437a-41ff-93f3-1091857b39c8] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:35.135620 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:35.136152 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:35.136959 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:35.137403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:35.152949 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] HTTP exception thrown: Instance 8d458f0b-437a-41ff-93f3-1091857b39c8 could not be found. Nov 02 13:01:35.153531 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Returning 404 to user: Instance 8d458f0b-437a-41ff-93f3-1091857b39c8 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:01:35.154350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-de709157-4f60-4b49-ad88-88a53ae7bf7b tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8" status: 404 len: 111 microversion: 2.1 time: 0.030765 Nov 02 13:01:35.154883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 416/855] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:35 2022] GET /compute/v2.1/servers/8d458f0b-437a-41ff-93f3-1091857b39c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:35.164027 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:35.164601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:35.170791 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:35.171417 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:35.172174 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:35.172631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:35.196925 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:01:35.291935 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-44ddce92-0ac3-4966-8078-7ed06149edf9 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "DELETE /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 204 len: 0 microversion: 2.1 time: 0.131869 Nov 02 13:01:35.292724 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 440/856] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:35 2022] DELETE /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:35.301136 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:35.301763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:35.308278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:35.308702 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:35.309455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:35.309892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:35.458733 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:35.467036 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-82f4fdd7-dc3c-41a0-8456-97943703ebd6 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.169790 Nov 02 13:01:35.467620 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 417/857] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:35 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:01:36.491655 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:36.492561 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:36.499469 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:36.500027 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:36.500791 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:36.501264 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:36.649388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d35ac129c24e118df9ebee0c8c9f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d086a8e68a94153b5d2a15d6d54fc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:36.657731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e3efbb75-abee-4a40-914c-b180fc97bc69 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 200 len: 1522 microversion: 2.1 time: 0.170478 Nov 02 13:01:36.658337 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 441/858] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:36 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:36.824053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-cd6b7578-2dc2-40ec-9402-d4ccc4a9dcac req-719d9637-c55b-47f1-bb07-47be21fdeee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d7f87e-6c63-40ee-9bf3-e454b81d34ee", "name": "network-vif-deleted", "tag": "77048807-cd5e-48b1-8d83-bf09988266df"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:36.833014 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-cd6b7578-2dc2-40ec-9402-d4ccc4a9dcac req-719d9637-c55b-47f1-bb07-47be21fdeee3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:36.833448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-cd6b7578-2dc2-40ec-9402-d4ccc4a9dcac req-719d9637-c55b-47f1-bb07-47be21fdeee3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:36.846228 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-cd6b7578-2dc2-40ec-9402-d4ccc4a9dcac req-719d9637-c55b-47f1-bb07-47be21fdeee3 service nova] Creating event network-vif-deleted:77048807-cd5e-48b1-8d83-bf09988266df for instance 28d7f87e-6c63-40ee-9bf3-e454b81d34ee on hv-cinder-86327 Nov 02 13:01:36.852668 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-cd6b7578-2dc2-40ec-9402-d4ccc4a9dcac req-719d9637-c55b-47f1-bb07-47be21fdeee3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 Nov 02 13:01:36.854717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 418/859] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:37.684815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:37.685441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] [instance: 28d7f87e-6c63-40ee-9bf3-e454b81d34ee] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:37.692908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:37.693680 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:37.694484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:37.694934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:37.713435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] HTTP exception thrown: Instance 28d7f87e-6c63-40ee-9bf3-e454b81d34ee could not be found. Nov 02 13:01:37.714203 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] Returning 404 to user: Instance 28d7f87e-6c63-40ee-9bf3-e454b81d34ee could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:01:37.715052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2ff76631-0e57-4357-b7ae-0d848f0fbf11 tempest-ServerRescueNegativeTestJSON-356330053 tempest-ServerRescueNegativeTestJSON-356330053-project] 10.222.0.90 "GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee" status: 404 len: 111 microversion: 2.1 time: 0.036094 Nov 02 13:01:37.715601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 442/860] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:37 2022] GET /compute/v2.1/servers/28d7f87e-6c63-40ee-9bf3-e454b81d34ee => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:46.757646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-371d98c9-c5c3-4147-a7c1-71f0e757e678 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:46.758655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-371d98c9-c5c3-4147-a7c1-71f0e757e678 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:46.765306 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-371d98c9-c5c3-4147-a7c1-71f0e757e678 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:46.765758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-371d98c9-c5c3-4147-a7c1-71f0e757e678 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:46.766520 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-371d98c9-c5c3-4147-a7c1-71f0e757e678 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:46.766954 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-371d98c9-c5c3-4147-a7c1-71f0e757e678 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:46.797680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-371d98c9-c5c3-4147-a7c1-71f0e757e678 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045217 Nov 02 13:01:46.798261 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 419/861] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:01:46 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:01:46.862965 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:46.863564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:46.870221 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:46.870682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:46.871465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:46.871934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:46.899602 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:01:46.984570 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b4b8428b-e054-4719-81db-a4bdda8f5856 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 204 len: 0 microversion: 2.1 time: 0.125588 Nov 02 13:01:46.989038 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 443/862] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:01:46 2022] DELETE /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:01:46.994441 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:46.995254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:47.003086 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:47.003558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:47.004467 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:47.004932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:47.168991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:47.178443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c77f1cc0-d3fd-4c58-a1d4-dcf8a8ceb0bc tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1672 microversion: 2.1 time: 0.187977 Nov 02 13:01:47.179057 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 420/863] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:46 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:48.204063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:48.204957 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:48.211627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:48.212090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:48.212937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:48.213380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:48.361683 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:48.369989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9b879803-a016-44c9-b78e-070391e97946 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1672 microversion: 2.1 time: 0.170520 Nov 02 13:01:48.370692 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 444/864] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:48 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:49.395505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:49.396191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:49.403120 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:49.403692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:49.404790 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:49.405389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:49.507126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:49.524113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-22b5d4c2-4691-4b1a-8516-65628dfead42 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 200 len: 1604 microversion: 2.1 time: 0.131887 Nov 02 13:01:49.524925 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 421/865] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:49 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 1604 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:49.538394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-9b320f26-30e5-46f8-ac0d-c7c04ec606a1 req-9b4156ee-f3d8-4304-922b-35cc20f76735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe9d261-592b-4b69-944d-5517465f6c40", "name": "network-vif-deleted", "tag": "6f41fdae-476d-4c30-ba0a-43899e265ad5"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:49.550563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9b320f26-30e5-46f8-ac0d-c7c04ec606a1 req-9b4156ee-f3d8-4304-922b-35cc20f76735 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:49.551012 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9b320f26-30e5-46f8-ac0d-c7c04ec606a1 req-9b4156ee-f3d8-4304-922b-35cc20f76735 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:49.563322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-9b320f26-30e5-46f8-ac0d-c7c04ec606a1 req-9b4156ee-f3d8-4304-922b-35cc20f76735 service nova] Creating event network-vif-deleted:6f41fdae-476d-4c30-ba0a-43899e265ad5 for instance ebe9d261-592b-4b69-944d-5517465f6c40 on hv-cinder-86327 Nov 02 13:01:49.572193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-9b320f26-30e5-46f8-ac0d-c7c04ec606a1 req-9b4156ee-f3d8-4304-922b-35cc20f76735 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046800 Nov 02 13:01:49.573951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 445/866] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:01:50.551645 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:50.552885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:50.559251 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:50.559710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:50.560520 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:50.561122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:50.576539 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] HTTP exception thrown: Instance ebe9d261-592b-4b69-944d-5517465f6c40 could not be found. Nov 02 13:01:50.577151 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Returning 404 to user: Instance ebe9d261-592b-4b69-944d-5517465f6c40 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:01:50.578178 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fc73f6b3-3ec1-4c1d-90aa-bdc57d53d35e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 404 len: 111 microversion: 2.1 time: 0.033011 Nov 02 13:01:50.579082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 422/867] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:50 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:50.595117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aa203e43-4d83-4974-a606-782e28cfd608 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '.version_select at 0x7fbe41ed3430>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:50.638117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aa203e43-4d83-4974-a606-782e28cfd608 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273704677" status: 202 len: 0 microversion: 2.1 time: 0.041687 Nov 02 13:01:50.638117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 446/868] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Nov 2 13:01:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273704677 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:01:51.341522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a1820d60-f541-4f64-ae66-07bb66698b8f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'create', calling method: .version_select at 0x7fbe4275d3a0>, body: {"keypair": {"name": "tempest-keypair-2044008374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuGuWMRkIJeD8MmwfWmKcYXl23A4X+7WVU3cie+3Vi5A6b9YMeXchldBo6FFQdRIRVAiIC72kgsMmnX2w1IWvKh8NjKH/ebaPWn5rYmN99GZbYS+y0SyWWgOfLTr4pRsA=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:51.356869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-a1820d60-f541-4f64-ae66-07bb66698b8f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:01:51.361953 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-a1820d60-f541-4f64-ae66-07bb66698b8f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for user 3a45298a10af4fc3991887cb4da55e86 and project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:01:51.396438 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a1820d60-f541-4f64-ae66-07bb66698b8f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059040 Nov 02 13:01:51.397079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 423/869] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 13:01:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:52.757977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1113778793", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1899e874-a496-4913-9de6-503fed5c449b"}], "security_groups": [{"name": "tempest-securitygroup--1390532497"}], "key_name": "tempest-keypair-2044008374", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:52.864809 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] validate_networks() for [('1899e874-a496-4913-9de6-503fed5c449b', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:01:53.280686 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:01:53.281494 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:01:53.281983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:01:53.282473 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:01:53.282889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:01:53.292816 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:53.293545 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:53.295276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:53.296135 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:53.314569 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:01:53.319496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Getting quotas for user 3a45298a10af4fc3991887cb4da55e86 and project ac56ac8efe2d4a07aa0f1c7976ad8fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:01:53.331735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:01:53.334301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:01:53.381715 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-89b3bda5-8b44-43da-8cf5-15dd168d38c5 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.628863 Nov 02 13:01:53.382485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 447/870] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:01:53.396075 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a006edd6-c571-4de3-8fd2-96c58c2abe6f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:53.397002 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a006edd6-c571-4de3-8fd2-96c58c2abe6f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:53.454547 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a006edd6-c571-4de3-8fd2-96c58c2abe6f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:53.462923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a006edd6-c571-4de3-8fd2-96c58c2abe6f tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1238 microversion: 2.1 time: 0.071443 Nov 02 13:01:53.463653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 424/871] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:53 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:54.488194 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:54.494724 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:54.502676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:54.503425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:54.504432 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:54.505015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:54.578831 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:54.588828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1c59b2b4-bafc-4434-b5ea-7daa4a24d5d9 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1298 microversion: 2.1 time: 0.105951 Nov 02 13:01:54.589860 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 448/872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:54 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:55.618681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:55.619236 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:55.627406 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:55.628087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:55.629018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:55.629499 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:55.882927 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:55.892387 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7a023c38-1614-4e94-9736-16e9b4426e11 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1364 microversion: 2.1 time: 0.277360 Nov 02 13:01:55.892986 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 425/873] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:55 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:56.003635 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-3ae3536f-da27-4eee-a938-2c75d383b122 req-4cd187d6-a130-41a7-b40c-3e90e39b0677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a", "tag": "654851c5-9c7f-4ed7-a238-c4cf149d0934"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:56.013980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3ae3536f-da27-4eee-a938-2c75d383b122 req-4cd187d6-a130-41a7-b40c-3e90e39b0677 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:56.014437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3ae3536f-da27-4eee-a938-2c75d383b122 req-4cd187d6-a130-41a7-b40c-3e90e39b0677 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:56.029562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-3ae3536f-da27-4eee-a938-2c75d383b122 req-4cd187d6-a130-41a7-b40c-3e90e39b0677 service nova] Creating event network-changed:654851c5-9c7f-4ed7-a238-c4cf149d0934 for instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a on hv-cinder-86327 Nov 02 13:01:56.035487 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-3ae3536f-da27-4eee-a938-2c75d383b122 req-4cd187d6-a130-41a7-b40c-3e90e39b0677 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035653 Nov 02 13:01:56.036137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 449/874] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:56.920465 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:56.921716 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:56.932034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:56.932933 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:56.934204 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:56.934869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:57.267298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:57.280982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e97eb7db-204e-4204-be40-a44aa89e5cc0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1364 microversion: 2.1 time: 0.367506 Nov 02 13:01:57.282310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 426/875] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:56 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:58.307807 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:58.308550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:58.315223 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:58.315945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:58.317069 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:58.317513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:58.456614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:58.464841 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bf20b388-2adc-4fbb-a630-b53ea78700db tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1364 microversion: 2.1 time: 0.161834 Nov 02 13:01:58.465610 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 450/876] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:58 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:59.488312 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:59.489048 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:01:59.497310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:59.497822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:59.498838 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:01:59.499280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:01:59.652601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:59.660597 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-79203f6b-4e38-41c4-9267-ab9e20612580 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1364 microversion: 2.1 time: 0.176187 Nov 02 13:01:59.661482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 427/877] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:59 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:00.685645 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:00.686276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:00.692951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:00.693408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:00.694198 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:00.694643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:00.839961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:00.847742 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0fc591e3-2690-4979-ba91-d008e4a35b3e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1364 microversion: 2.1 time: 0.166428 Nov 02 13:02:00.848490 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 451/878] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:00 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:01.763530 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d4694e1c-1e35-4707-9c98-1b6d4cf96137 req-bf5ed2ac-6a92-44ae-ac24-472c5d294606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a", "name": "network-vif-plugged", "status": "completed", "tag": "654851c5-9c7f-4ed7-a238-c4cf149d0934"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:01.772307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d4694e1c-1e35-4707-9c98-1b6d4cf96137 req-bf5ed2ac-6a92-44ae-ac24-472c5d294606 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:01.772764 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d4694e1c-1e35-4707-9c98-1b6d4cf96137 req-bf5ed2ac-6a92-44ae-ac24-472c5d294606 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:01.784421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d4694e1c-1e35-4707-9c98-1b6d4cf96137 req-bf5ed2ac-6a92-44ae-ac24-472c5d294606 service nova] Creating event network-vif-plugged:654851c5-9c7f-4ed7-a238-c4cf149d0934 for instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a on hv-cinder-86327 Nov 02 13:02:01.789473 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d4694e1c-1e35-4707-9c98-1b6d4cf96137 req-bf5ed2ac-6a92-44ae-ac24-472c5d294606 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030143 Nov 02 13:02:01.790132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 428/879] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:01.874192 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:01.875197 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:01.882261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:01.882799 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:01.883715 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:01.884145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:02.025896 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:02.034225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eab28f05-b549-4f3e-83c9-898d8240d5c0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1364 microversion: 2.1 time: 0.163986 Nov 02 13:02:02.034936 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 452/880] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:01 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:03.060407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:03.061110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:03.067996 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:03.068481 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:03.069266 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:03.069711 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:03.212761 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:03.224268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d6413b3b-8906-47ad-b4c6-c79c2e5aa709 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1364 microversion: 2.1 time: 0.169322 Nov 02 13:02:03.225025 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 429/881] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:03 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:04.251407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:04.253191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:04.260988 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:04.261443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:04.262222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:04.263263 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:04.415882 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:04.424497 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2b24e26b-0348-4056-9b72-9bc1a7cee40d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1550 microversion: 2.1 time: 0.178034 Nov 02 13:02:04.425080 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 453/882] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:04 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1550 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:04.452480 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-239e99f9-e3a7-4feb-80e9-27d9724d3dc6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:04.455298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-239e99f9-e3a7-4feb-80e9-27d9724d3dc6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:04.463177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-239e99f9-e3a7-4feb-80e9-27d9724d3dc6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:04.463632 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-239e99f9-e3a7-4feb-80e9-27d9724d3dc6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:04.464698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-239e99f9-e3a7-4feb-80e9-27d9724d3dc6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:04.465147 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-239e99f9-e3a7-4feb-80e9-27d9724d3dc6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:04.559505 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-239e99f9-e3a7-4feb-80e9-27d9724d3dc6 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113380 Nov 02 13:02:04.560328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 430/883] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 13:02:04 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:05.627491 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-c8e62261-b6d7-4a5d-897f-713329d53d93 req-45aaec52-c78e-48c7-8bb7-c60079fc68f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a", "tag": "654851c5-9c7f-4ed7-a238-c4cf149d0934"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:05.635910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c8e62261-b6d7-4a5d-897f-713329d53d93 req-45aaec52-c78e-48c7-8bb7-c60079fc68f0 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:05.636638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c8e62261-b6d7-4a5d-897f-713329d53d93 req-45aaec52-c78e-48c7-8bb7-c60079fc68f0 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:05.659650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-c8e62261-b6d7-4a5d-897f-713329d53d93 req-45aaec52-c78e-48c7-8bb7-c60079fc68f0 service nova] Creating event network-changed:654851c5-9c7f-4ed7-a238-c4cf149d0934 for instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a on hv-cinder-86327 Nov 02 13:02:05.665043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-c8e62261-b6d7-4a5d-897f-713329d53d93 req-45aaec52-c78e-48c7-8bb7-c60079fc68f0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041589 Nov 02 13:02:05.665744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 454/884] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:42.869033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-339d20d8-f047-4cfc-897f-c05530a118d3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:42.869861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-339d20d8-f047-4cfc-897f-c05530a118d3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:42.877369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-339d20d8-f047-4cfc-897f-c05530a118d3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:42.877696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-339d20d8-f047-4cfc-897f-c05530a118d3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:42.878492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-339d20d8-f047-4cfc-897f-c05530a118d3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:42.878927 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-339d20d8-f047-4cfc-897f-c05530a118d3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:42.906720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-339d20d8-f047-4cfc-897f-c05530a118d3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/ips" status: 200 len: 152 microversion: 2.20 time: 0.042257 Nov 02 13:02:42.907774 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 431/885] 10.222.0.90 () {60 vars in 1289 bytes} [Wed Nov 2 13:02:42 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:02:45.196529 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:45.197828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:45.210709 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:45.211795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:45.213063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:45.214669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:45.253229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lazy-loading 'flavor' on Instance uuid 45cf2036-8434-479c-a251-9f6411e8062a {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:02:45.876117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-46c1314c-c149-4e25-832f-852ad85d6cbe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/action" status: 202 len: 0 microversion: 2.20 time: 0.684606 Nov 02 13:02:45.877017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 455/886] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Nov 2 13:02:45 2022] POST /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:02:45.889758 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:45.892050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:45.901045 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:45.901821 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:45.902931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:45.903313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:46.166117 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:46.177370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:46.180081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:46.182206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c6354ecc-3b15-43da-8fa1-5794bc604584 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.299407 Nov 02 13:02:46.183310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 432/887] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:45 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:02:47.213370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:47.214981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:47.223062 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:47.223946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:47.225103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:47.225767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:47.418758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:47.438270 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:47.441438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:47.443603 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-64d09f3f-c170-4f59-b917-1688ec609f01 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.235659 Nov 02 13:02:47.444564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 456/888] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:47 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:48.471832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:48.472545 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:48.479193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:48.479678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:48.480829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:48.481656 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:48.754465 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:48.763723 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:48.765551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:48.766909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a7c574c3-c4c2-4ab8-a152-f4073128aede tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.299710 Nov 02 13:02:48.767965 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 433/889] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:48 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:49.804682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:49.805308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:49.814240 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:49.815124 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:49.816330 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:49.816971 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:50.234726 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:50.249152 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:50.251184 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:50.253134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c382ef2b-224a-411d-8340-ae4ba25cec0c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.453244 Nov 02 13:02:50.254224 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 457/890] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:49 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:51.290026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:51.292247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:51.306259 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:51.306850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:51.307531 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:51.307966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:51.587795 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:51.598155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:51.601486 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:51.603523 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ad960ef2-b725-4bc6-9361-a894d422a00c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.321004 Nov 02 13:02:51.604743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 434/891] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:51 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:52.632899 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:52.634445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:52.646005 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:52.646901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:52.648647 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:52.649877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:52.928508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:52.941482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:52.943154 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:52.944496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bd868072-0aa6-4a5d-b4c0-1f41ad9c741d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.316489 Nov 02 13:02:52.945273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 458/892] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:52 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:53.988049 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:53.988775 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:53.996247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:53.996991 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:53.998050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:53.998710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:54.199444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:54.211362 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:54.213113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:54.214485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3989269e-e3de-4b14-91a1-b7eda132a88f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.238636 Nov 02 13:02:54.215482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 435/893] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:53 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:55.262145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:55.263003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:55.285320 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:55.286137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:55.292759 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:55.295866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:55.584930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:55.613114 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:55.615777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:55.617538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0d753206-e0a8-42c7-8a1d-69b4621cd418 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.373124 Nov 02 13:02:55.629002 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 459/894] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:55 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:02:56.661481 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:56.663537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:56.679191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:56.680266 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:56.681726 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:56.682424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:56.888189 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:56.897070 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:56.899624 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:56.900950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c28d6d6f-965e-4023-aa7e-46eb01268d97 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.248332 Nov 02 13:02:56.901759 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 436/895] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:56 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:02:57.931329 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:57.931937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:57.943358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:57.944376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:57.947036 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:57.948195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:58.155356 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:58.170987 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:58.175114 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:58.177294 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7505d64f-d87b-4252-97e4-c38968a5c134 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1743 microversion: 2.20 time: 0.249690 Nov 02 13:02:58.196403 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 460/896] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:57 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:02:59.218260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:59.220450 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:02:59.228712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:59.229241 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:59.230268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:02:59.230792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:02:59.505834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:59.523880 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:59.526409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:59.529841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0ccad62e-4b39-4d45-b867-2f19406427a1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1743 microversion: 2.20 time: 0.316875 Nov 02 13:02:59.544963 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 437/897] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:02:59 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1743 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:01.016455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:01.019865 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:01.033030 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:01.034031 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:01.035107 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:01.035637 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:01.272250 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:01.282238 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:01.284195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:01.285309 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a3dd04c1-fce7-43df-8629-e410d3e6b472 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1743 microversion: 2.20 time: 0.728035 Nov 02 13:03:01.286170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 461/898] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:00 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1743 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:02.113311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-200a51bd-61c5-41a5-b058-435bdde3c406 req-15797322-5eb2-4ac0-aa81-02dd09ee7f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cf2036-8434-479c-a251-9f6411e8062a", "name": "network-vif-plugged", "status": "completed", "tag": "d5aae24c-ac0a-4c55-b771-4ccad1cc65ab"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:02.124347 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-200a51bd-61c5-41a5-b058-435bdde3c406 req-15797322-5eb2-4ac0-aa81-02dd09ee7f05 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:02.125455 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-200a51bd-61c5-41a5-b058-435bdde3c406 req-15797322-5eb2-4ac0-aa81-02dd09ee7f05 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:02.142728 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-200a51bd-61c5-41a5-b058-435bdde3c406 req-15797322-5eb2-4ac0-aa81-02dd09ee7f05 service nova] Creating event network-vif-plugged:d5aae24c-ac0a-4c55-b771-4ccad1cc65ab for instance 45cf2036-8434-479c-a251-9f6411e8062a on hv-cinder-86327 Nov 02 13:03:02.148639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-200a51bd-61c5-41a5-b058-435bdde3c406 req-15797322-5eb2-4ac0-aa81-02dd09ee7f05 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039721 Nov 02 13:03:02.150113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 438/899] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:02.311259 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:02.311975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:02.319943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:02.320658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:02.321615 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:02.322237 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:02.520301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:02.529346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:02.532025 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:02.533697 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2ef3f543-bcd0-4df9-8a29-6e68c0fdeeee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1743 microversion: 2.20 time: 0.226478 Nov 02 13:03:02.534748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 462/900] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:02 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1743 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:03.562584 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:03.563983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:03.571833 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:03.572593 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:03.573394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:03.573840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:03.736247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:03.744702 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:03.746188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:03.747367 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-853c5779-ed8e-4464-a674-31c1c6decd93 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1743 microversion: 2.20 time: 0.189816 Nov 02 13:03:03.747935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 439/901] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:03 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:03.870180 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-427d45f0-6e11-4008-ad40-dbc0643b1316 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Action: 'create', calling method: .version_select at 0x7fbe41ed3700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-90965896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpSMkqYDXmc47qJSeu3HetdnhtNQaz2f3EbYKjjJxMSb3YEK2PvtZ31jXjvzvLpELqAC581Rw0vCCOAPCZ7kZs/mp+vnGlRu1WDspumoXFDah9Gnh+E0xE40+cYg3yEkg=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:03.885199 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-427d45f0-6e11-4008-ad40-dbc0643b1316 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Getting quotas for project 5716ca4d4fc14873bdb6a99cecc9ed64. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:03:03.889654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-427d45f0-6e11-4008-ad40-dbc0643b1316 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Getting quotas for user 68c52946945e41e8910c7179b03af2b6 and project 5716ca4d4fc14873bdb6a99cecc9ed64. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:03:03.912711 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-427d45f0-6e11-4008-ad40-dbc0643b1316 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.047545 Nov 02 13:03:03.913535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 463/902] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 13:03:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:03.970125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2037486550", "imageRef": "a76baff2-ecdd-43bd-b93f-b0c1193a2015", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-90965896", "networks": [{"uuid": "ae46113b-3acc-4bc8-9509-58e63614d6ec"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:04.024446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] validate_networks() for [('ae46113b-3acc-4bc8-9509-58e63614d6ec', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:03:04.488296 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:03:04.488724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:03:04.489199 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:03:04.489607 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:03:04.490014 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:03:04.502010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:04.502247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:04.503277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:04.503879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:04.532236 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Getting quotas for project 5716ca4d4fc14873bdb6a99cecc9ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:03:04.538718 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Getting quotas for user 68c52946945e41e8910c7179b03af2b6 and project 5716ca4d4fc14873bdb6a99cecc9ed64. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:03:04.552592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:03:04.555202 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a76baff2-ecdd-43bd-b93f-b0c1193a2015',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:03:04.606385 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-53ecf87a-3697-483e-b2b4-7f56384efcce tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640413 Nov 02 13:03:04.612427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 440/903] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:03:04.621640 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ec91bd36-dbeb-4249-864b-7eae928fdadd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:04.622746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ec91bd36-dbeb-4249-864b-7eae928fdadd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:04.717133 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ec91bd36-dbeb-4249-864b-7eae928fdadd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:04.726124 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ec91bd36-dbeb-4249-864b-7eae928fdadd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1257 microversion: 2.1 time: 0.111428 Nov 02 13:03:04.727064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 464/904] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:04 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1257 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:04.775130 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:04.775733 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:04.787894 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:04.789400 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:04.791192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:04.791663 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:04.993771 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:05.006378 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:05.009144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:05.010544 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a0265eb0-6018-4070-89a5-db870d6b76d5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.239478 Nov 02 13:03:05.011299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 441/905] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:04 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:05.749052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:05.750319 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:05.757261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:05.757888 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:05.758859 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:05.759300 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:05.836789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:05.845493 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3071ec9b-be79-4b39-b903-6395cb552e61 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1309 microversion: 2.1 time: 0.100537 Nov 02 13:03:05.846831 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 465/906] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:05 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:06.037727 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:06.038362 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:06.048798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:06.049728 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:06.050756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:06.051593 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:06.656460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:06.668307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:06.670727 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:06.673969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e21e3584-e5f9-4c6b-b645-93592caf2613 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.640287 Nov 02 13:03:06.675242 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 442/907] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:06 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:06.870104 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:06.870720 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:06.881443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:06.882303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:06.883515 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:06.884176 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:06.962807 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:06.970676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fa0fe277-ea4c-4d83-9152-2872dbbf8500 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1315 microversion: 2.1 time: 0.104657 Nov 02 13:03:06.972160 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 466/908] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:06 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1315 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:07.704966 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:07.706722 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:07.714355 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:07.715254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:07.716296 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:07.717136 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:07.888955 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:07.897823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:07.899581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:07.901281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e95c4b7-d228-472f-9f52-9a60d41f1e0b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.203947 Nov 02 13:03:07.902041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 443/909] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:07 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:07.996091 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:07.997340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:08.007248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:08.008048 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:08.008944 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:08.009572 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:08.344638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:08.357269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5513bf6d-6c7d-4e4c-a13e-c335065e2544 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.364803 Nov 02 13:03:08.358246 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 467/910] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:07 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:08.931946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:08.937000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:08.948392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:08.949167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:08.950190 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:08.950822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:09.115241 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:09.124006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:09.126030 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:09.127469 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-15eb6ae9-9b2c-45f1-9415-8d3aed0e4e75 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.204243 Nov 02 13:03:09.128042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 444/911] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:08 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:09.406276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:09.407067 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:09.414324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:09.414796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:09.415889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:09.416779 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:09.587503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:09.596885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-94a69acf-47cd-4f2f-a775-83be349f617c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.197023 Nov 02 13:03:09.613109 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 468/912] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:09 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:10.154668 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:10.155750 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:10.164919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:10.168383 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:10.169238 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:10.169835 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:10.365819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:10.378281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:10.380177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:10.381708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0eb31305-2a73-49b3-b108-cc2240b87dd8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.232235 Nov 02 13:03:10.397137 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 445/913] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:10 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:10.622301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:10.623869 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:10.648595 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:10.648955 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:10.649745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:10.650175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:11.027417 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:11.039085 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-da08e875-38b0-41ba-af68-97182a8dc464 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.420056 Nov 02 13:03:11.040747 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 469/914] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:10 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:11.411569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:11.412973 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:11.426209 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:11.427709 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:11.429456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:11.429907 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:11.767951 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:11.777666 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:11.785602 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:11.787598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5a8d8d8a-1521-46f6-801f-09354f6000e1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.380765 Nov 02 13:03:11.805691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 446/915] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:11 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:12.066970 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:12.067567 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:12.084245 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:12.084580 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:12.085577 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:12.086203 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:12.248940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:12.258220 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f266f736-8303-451d-aac1-6a089c1fa615 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.195113 Nov 02 13:03:12.259017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 470/916] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:12 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:12.816541 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:12.817319 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:12.823940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:12.824492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:12.825342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:12.825876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:13.034614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:13.044035 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:13.046500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:13.048076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e19d460c-1f67-40ef-9792-7e67db3e5639 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.235654 Nov 02 13:03:13.049208 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 447/917] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:12 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:13.283316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:13.283947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:13.290570 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:13.291316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:13.292318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:13.292932 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:13.443628 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:13.451711 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e4b88280-00ff-454e-a4b9-44f2f9e8b80f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.172798 Nov 02 13:03:13.452949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 471/918] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:13 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:14.083550 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:14.085646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:14.093633 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:14.094375 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:14.095378 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:14.095814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:14.296872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:14.310527 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:14.312918 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:14.314466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f26fec39-02cc-4950-bb35-2f282e0d3cc4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.235500 Nov 02 13:03:14.315100 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 448/919] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:14 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:14.486816 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:14.488137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:14.496413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:14.497211 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:14.498039 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:14.498604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:14.690785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:14.709885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8ad81a8f-0b2f-4911-9883-c08a45a963a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.227895 Nov 02 13:03:14.711801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 472/920] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:14 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:15.341640 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:15.342437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:15.349993 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:15.350578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:15.351725 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:15.352522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:15.560389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:15.575749 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:15.578317 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:15.584698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-39d5eaa4-8453-4c18-a802-1412ff49b928 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.247007 Nov 02 13:03:15.596655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 449/921] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:15 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:15.769551 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:15.770824 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:15.783858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:15.784767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:15.785612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:15.786226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:15.979222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:15.988221 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8cb3bad2-ce0c-49c5-8eb2-56e4250ca3f6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.223091 Nov 02 13:03:15.988811 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 473/922] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:15 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:16.617134 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:16.618415 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:16.625827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:16.626674 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:16.627464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:16.627894 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:16.788760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:16.807166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:16.808677 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:16.809868 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b25b3393-1591-4d0f-9f60-accc0ec94a46 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.196841 Nov 02 13:03:16.810426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 450/923] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:16 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:17.011940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:17.012771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:17.021216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:17.021663 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:17.022721 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:17.023216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:17.177233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:17.185275 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-73aeca4b-0d1e-49f0-9416-9d066a82fd47 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.177908 Nov 02 13:03:17.186399 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 474/924] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:17 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:17.837025 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:17.837627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:17.844498 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:17.844958 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:17.845744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:17.846190 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:17.994309 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:18.003109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:18.005053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:18.006828 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-105d7621-4fd6-46d0-ad55-46ed1c37c2db tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.173958 Nov 02 13:03:18.008142 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 451/925] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:17 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:18.211029 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:18.211658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:18.213449 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-365403763", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2037140484", "security_groups": [{"name": "tempest-secgroup-smoke-994655925"}], "block_device_mapping_v2": [{"uuid": "9ca7b2d6-8183-4573-ba1c-b4d8c4bf880c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dc24f821-79ec-4404-92fe-d5786cb39ed4"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:18.220450 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:18.220906 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:18.233922 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:18.234444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:18.343338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] validate_networks() for [('dc24f821-79ec-4404-92fe-d5786cb39ed4', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:03:18.408631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:18.418115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b570cf3d-3404-4a05-b4cd-90bc00f7f10e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.210863 Nov 02 13:03:18.418696 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 475/926] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:18 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:18.787661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:03:18.788425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:03:18.789108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:03:18.789692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:03:18.790346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:03:18.807210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:18.808171 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:18.809431 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:18.810097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:18.828684 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:03:18.833046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Getting quotas for user 8c01ed6e76ef4ee4ba5356c526e113e4 and project 1ffa8215f4d6479babed8b59e14b7e39. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:03:18.894490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:03:18.896873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ca7b2d6-8183-4573-ba1c-b4d8c4bf880c',volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:03:19.040730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:19.044567 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:19.050288 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7fa26818-f6d2-41b8-a50e-4d0e838cad2c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.840586 Nov 02 13:03:19.051119 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 452/927] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:03:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:03:19.061920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:19.061920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:19.062373 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a663e8cb-56c3-4ec3-8968-4c6bd7a44f0a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:19.062612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:19.062947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a663e8cb-56c3-4ec3-8968-4c6bd7a44f0a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:19.063088 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:19.134525 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a663e8cb-56c3-4ec3-8968-4c6bd7a44f0a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:19.144237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a663e8cb-56c3-4ec3-8968-4c6bd7a44f0a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1094 microversion: 2.1 time: 0.084726 Nov 02 13:03:19.144237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 453/928] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:19 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:19.267689 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:19.278233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:19.282566 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:19.284405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3a84e6d9-d4f4-42c2-bf5e-1aae4f481145 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.252696 Nov 02 13:03:19.285448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 476/929] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:19 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:19.442979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:19.444006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:19.455584 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:19.456071 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:19.456897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:19.457335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:19.620272 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:19.631334 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7350147c-73be-441c-9ee0-6c77d0470258 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.192849 Nov 02 13:03:19.644234 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 454/930] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:19 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:20.167685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:20.168130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:20.176325 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:20.176901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:20.177579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:20.178053 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:20.241762 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:20.250177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b170ec70-0d19-44db-b341-559e096bf108 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1144 microversion: 2.1 time: 0.086800 Nov 02 13:03:20.250760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 477/931] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:20 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:20.312582 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:20.313584 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:20.321476 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:20.322042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:20.322829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:20.323278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:20.471502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:20.480247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:20.481739 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:20.483161 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e494ce76-184d-4003-91b7-3917f46cb8bb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.174941 Nov 02 13:03:20.483798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 455/932] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:20 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:20.660505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:20.661130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:20.667632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:20.668098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:20.669244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:20.669683 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:20.817808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:20.830963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-41dec758-f9fa-4c31-946d-95de0045f2e4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.174257 Nov 02 13:03:20.831881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 478/933] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:20 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:21.275115 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:21.275712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:21.282858 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:21.283317 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:21.284089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:21.284549 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:21.350558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:21.362687 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b89b2720-22c0-4b79-97d2-ca5841698829 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1144 microversion: 2.1 time: 0.091260 Nov 02 13:03:21.363792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 456/934] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:21 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:21.509294 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:21.509949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:21.518954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:21.519488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:21.520858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:21.521485 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:21.682396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:21.693854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:21.695327 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:21.696526 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-01f460b6-3c1b-46ad-8ab0-a65ce728527c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.191347 Nov 02 13:03:21.697092 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 479/935] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:21 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:21.863508 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:21.864125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:21.871126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:21.871508 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:21.872318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:21.872745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:22.016591 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:22.026606 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-72ca8dad-ccad-4a6d-8c2e-8fc79cd5e66b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.166912 Nov 02 13:03:22.027427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 457/936] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:21 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:22.391541 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:22.392550 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:22.399688 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:22.400140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:22.400942 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:22.401377 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:22.463530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:22.471406 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9044beb4-02e0-4dff-a9a7-2356b09a1fb3 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1144 microversion: 2.1 time: 0.086941 Nov 02 13:03:22.471962 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 480/937] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:22 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:22.722641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:22.723254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:22.730239 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:22.730696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:22.731479 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:22.731919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:22.880354 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:22.890036 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:22.891550 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:22.892826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a7e5a8c8-a7c9-4d7e-bb40-dd04c399496f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.174515 Nov 02 13:03:22.893379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 458/938] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:22 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:23.050949 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:23.051509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:23.058459 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:23.058890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:23.059696 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:23.060113 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:23.208763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:23.216136 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-daa9dd40-e523-4c8e-8cd6-58f960add7f4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.169448 Nov 02 13:03:23.216756 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 481/939] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:23 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:23.494929 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:23.495540 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:23.502088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:23.502537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:23.503313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:23.503752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:23.568853 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:23.578597 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-22de1306-497f-4949-a6fb-7d3e0134de6f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1144 microversion: 2.1 time: 0.087523 Nov 02 13:03:23.579211 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 459/940] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:23 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:23.917926 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:23.918455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:23.925119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:23.925714 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:23.926504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:23.926923 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:24.092169 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:24.108326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:24.111227 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:24.113687 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6333ad2a-1242-4e45-9036-7611955524c6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.199557 Nov 02 13:03:24.114677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 482/941] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:23 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:24.241162 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:24.241777 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:24.248675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:24.249326 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:24.250417 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:24.250850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:24.602553 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:24.603178 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:24.606884 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:24.611403 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:24.611857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:24.612765 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:24.613318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:24.614793 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5c1cb7ac-306d-48bf-8b56-2f417c816d43 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.377781 Nov 02 13:03:24.623097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 460/942] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:24 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:24.677507 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:24.685114 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d709052b-a4fb-473c-979d-c7167a94f1b8 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1192 microversion: 2.1 time: 0.087235 Nov 02 13:03:24.685997 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 483/943] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:24 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:24.802216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-c43873c3-d264-465b-9b5a-ed337428d5ea req-9047b409-1dd0-4910-b08f-91869f3699d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895", "tag": "c9696789-eadb-4104-9a82-9ae275fb1c40"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:24.810943 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-c43873c3-d264-465b-9b5a-ed337428d5ea req-9047b409-1dd0-4910-b08f-91869f3699d5 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:24.811575 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-c43873c3-d264-465b-9b5a-ed337428d5ea req-9047b409-1dd0-4910-b08f-91869f3699d5 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:24.823834 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-c43873c3-d264-465b-9b5a-ed337428d5ea req-9047b409-1dd0-4910-b08f-91869f3699d5 service nova] Creating event network-changed:c9696789-eadb-4104-9a82-9ae275fb1c40 for instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 on hv-cinder-86327 Nov 02 13:03:24.829129 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-c43873c3-d264-465b-9b5a-ed337428d5ea req-9047b409-1dd0-4910-b08f-91869f3699d5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091996 Nov 02 13:03:24.829755 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 461/944] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:25.140866 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:25.142331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:25.150694 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:25.152314 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:25.152314 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:25.152513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:25.335521 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:25.343946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:25.345476 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:25.346706 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eeb7ab8e-a545-421c-85ac-0f689f55bea9 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1738 microversion: 2.20 time: 0.211203 Nov 02 13:03:25.347248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 484/945] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:25 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:25.640723 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:25.641497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:25.648282 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:25.648734 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:25.649516 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:25.649942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:25.711601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:25.712242 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:25.719276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:25.719793 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:25.720846 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:25.721353 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:25.781976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:25.789773 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ccfcbc1e-88a0-487a-a61b-39a7b3f76ddf tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1210 microversion: 2.1 time: 0.082133 Nov 02 13:03:25.790488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 485/946] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:25 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:25.800092 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:25.810615 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b6a1718a-558d-4df0-b49f-8ea55545be3f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.175026 Nov 02 13:03:25.811526 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 462/947] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:25 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:26.374730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:26.375449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:26.382099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:26.382662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:26.383410 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:26.383840 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:26.548968 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:26.559578 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:26.562031 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:26.563658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4fb32474-ac2e-42de-ba32-9a9c87ccadf8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1720 microversion: 2.20 time: 0.193308 Nov 02 13:03:26.564864 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 486/948] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:26 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:26.819130 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:26.819779 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:26.826639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:26.828485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:26.828485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:26.828485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:26.834226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:26.834844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:26.840892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:26.841350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:26.842355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:26.842783 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:26.921055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:26.929448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fe335c80-d881-4377-90b9-006e876910b4 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1198 microversion: 2.1 time: 0.115511 Nov 02 13:03:26.930023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 463/949] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:26 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:26.997547 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:27.006366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-355216f2-a34b-4435-9e0b-ca9f7145a140 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.176321 Nov 02 13:03:27.007195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 487/950] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:26 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:27.590538 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:27.591323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:27.598357 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:27.598820 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:27.599925 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:27.600488 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:27.853658 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:27.864210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:27.866368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:27.867794 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a70e3477-184b-4fab-8dc6-1bb3666bb4fe tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1720 microversion: 2.20 time: 0.281761 Nov 02 13:03:27.868389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 464/951] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:27 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:27.952807 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:27.953463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:27.960093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:27.960576 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:27.961356 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:27.961792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:28.039079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:28.040180 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:28.047939 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:28.048773 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:28.050000 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:28.050717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:28.144897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:28.158051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-05834a96-dc1d-46d3-ad40-40c6d4ef2e8c tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.209096 Nov 02 13:03:28.158664 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 488/952] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:27 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:28.163745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-a0969725-c686-4026-aa5a-317a13f17fdd req-2f7d2b3f-a3de-4a26-bf1a-bf1f518bbe4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754", "tag": "8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:28.174271 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-a0969725-c686-4026-aa5a-317a13f17fdd req-2f7d2b3f-a3de-4a26-bf1a-bf1f518bbe4c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:28.174723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-a0969725-c686-4026-aa5a-317a13f17fdd req-2f7d2b3f-a3de-4a26-bf1a-bf1f518bbe4c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:28.189087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-a0969725-c686-4026-aa5a-317a13f17fdd req-2f7d2b3f-a3de-4a26-bf1a-bf1f518bbe4c service nova] Creating event network-changed:8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11 for instance 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 on hv-cinder-86327 Nov 02 13:03:28.198482 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-a0969725-c686-4026-aa5a-317a13f17fdd req-2f7d2b3f-a3de-4a26-bf1a-bf1f518bbe4c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038600 Nov 02 13:03:28.211976 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 489/953] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:28.313276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-6f7d1580-1190-4eb2-9f5f-e9dea47f0a9b req-0286d1b3-e2ab-49f6-b4ef-000659c3c4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cf2036-8434-479c-a251-9f6411e8062a", "name": "network-vif-unplugged", "status": "completed", "tag": "d5aae24c-ac0a-4c55-b771-4ccad1cc65ab"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:28.330296 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6f7d1580-1190-4eb2-9f5f-e9dea47f0a9b req-0286d1b3-e2ab-49f6-b4ef-000659c3c4c8 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:28.331226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6f7d1580-1190-4eb2-9f5f-e9dea47f0a9b req-0286d1b3-e2ab-49f6-b4ef-000659c3c4c8 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:28.346745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:28.357067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-da6aa502-aba0-479e-ae8c-52955b9d22d1 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.329051 Nov 02 13:03:28.359881 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 465/954] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:28 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:28.364152 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-6f7d1580-1190-4eb2-9f5f-e9dea47f0a9b req-0286d1b3-e2ab-49f6-b4ef-000659c3c4c8 service nova] Creating event network-vif-unplugged:d5aae24c-ac0a-4c55-b771-4ccad1cc65ab for instance 45cf2036-8434-479c-a251-9f6411e8062a on hv-cinder-86327 Nov 02 13:03:28.370881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-6f7d1580-1190-4eb2-9f5f-e9dea47f0a9b req-0286d1b3-e2ab-49f6-b4ef-000659c3c4c8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067206 Nov 02 13:03:28.372098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 490/955] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:28.898138 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:28.898869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:28.905964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:28.906451 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:28.907298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:28.907791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:29.148789 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:29.157655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:29.159162 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:29.160587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4affaa4f-90c4-495e-ae05-63664b87e0cb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1720 microversion: 2.20 time: 0.269078 Nov 02 13:03:29.161159 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 466/956] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:28 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:29.185676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:29.186481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:29.193709 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:29.194096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:29.194881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:29.195324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:29.340559 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:29.351219 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5322139f-5312-403f-9686-fd0b65515855 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.169677 Nov 02 13:03:29.351800 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 491/957] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:29 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:29.384174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:29.384849 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:29.392168 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:29.392644 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:29.393400 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:29.393829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:29.536078 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:29.543744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4821afda-bfed-4a25-b5b9-8d2d34d1b96d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.164626 Nov 02 13:03:29.544346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 467/958] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:29 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:30.186814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:30.187461 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:30.193998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.194449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.195216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.195669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.337530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:30.345846 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:30.347730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:30.348970 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8a75f78f-8f72-4a9f-af82-81c800f65e0f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1663 microversion: 2.20 time: 0.166383 Nov 02 13:03:30.349557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 492/959] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:30 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:30.374395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:30.374876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a78fc95c-48e3-49c6-a2f7-f81488073481 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbf4ce93-0c5b-471d-9b76-9ecbdd88b57b"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:30.375369 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:30.376041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a78fc95c-48e3-49c6-a2f7-f81488073481 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:30.381727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.382173 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.382317 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a78fc95c-48e3-49c6-a2f7-f81488073481 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.382751 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a78fc95c-48e3-49c6-a2f7-f81488073481 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.382951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.383419 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.383598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a78fc95c-48e3-49c6-a2f7-f81488073481 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.383980 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a78fc95c-48e3-49c6-a2f7-f81488073481 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.533560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:30.541341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-98f7e6fe-b798-462d-a458-8fb29f227df0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.170970 Nov 02 13:03:30.541916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 493/960] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:30 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:30.567021 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:30.567770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:30.574293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.574730 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.575652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.576255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.669959 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a78fc95c-48e3-49c6-a2f7-f81488073481 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299492 Nov 02 13:03:30.671022 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 468/961] 10.222.0.90 () {62 vars in 1364 bytes} [Wed Nov 2 13:03:30 2022] POST /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:03:30.717428 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:30.725900 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c0704509-77cc-4873-b793-273f5ef4d46a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.162653 Nov 02 13:03:30.726511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 494/962] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:30 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:30.798946 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4c2d7e73-75b7-4690-a2eb-ec04b216640c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:30.799445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4c2d7e73-75b7-4690-a2eb-ec04b216640c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:30.805851 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c2d7e73-75b7-4690-a2eb-ec04b216640c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.806302 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c2d7e73-75b7-4690-a2eb-ec04b216640c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:30.807080 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c2d7e73-75b7-4690-a2eb-ec04b216640c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:30.807521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c2d7e73-75b7-4690-a2eb-ec04b216640c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.063614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4c2d7e73-75b7-4690-a2eb-ec04b216640c tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-volume_attachments/cbf4ce93-0c5b-471d-9b76-9ecbdd88b57b" status: 202 len: 0 microversion: 2.20 time: 0.268913 Nov 02 13:03:31.064371 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 469/963] 10.222.0.90 () {60 vars in 1457 bytes} [Wed Nov 2 13:03:30 2022] DELETE /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-volume_attachments/cbf4ce93-0c5b-471d-9b76-9ecbdd88b57b => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:03:31.129557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3a54e05a-76af-4e18-ac09-2d3ace625a8e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:31.130275 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3a54e05a-76af-4e18-ac09-2d3ace625a8e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:31.136629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a54e05a-76af-4e18-ac09-2d3ace625a8e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.137070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a54e05a-76af-4e18-ac09-2d3ace625a8e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.137844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a54e05a-76af-4e18-ac09-2d3ace625a8e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.138479 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3a54e05a-76af-4e18-ac09-2d3ace625a8e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.218093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3a54e05a-76af-4e18-ac09-2d3ace625a8e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "POST /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/action" status: 202 len: 0 microversion: 2.20 time: 0.092920 Nov 02 13:03:31.220284 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 495/964] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Nov 2 13:03:31 2022] POST /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:03:31.228730 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:31.229667 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:31.237320 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.238013 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.238801 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.239227 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.415005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:31.424629 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:31.426151 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:31.427330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c876adb3-0b16-41b6-923e-9d92d9fe8483 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1671 microversion: 2.20 time: 0.203578 Nov 02 13:03:31.427874 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 470/965] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:31 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:31.565391 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:31.566004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:31.572166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.572655 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.573463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.573894 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.720342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:31.728583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dfa67c9d-9ac9-442b-a8dd-d8fea49845ee tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.167036 Nov 02 13:03:31.729119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 496/966] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:31 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:31.749974 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:31.750587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:31.756859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.757312 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.758085 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:31.758524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:31.900821 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:31.908647 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9a7c4237-c888-453d-96f3-349f7eb19bc4 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.162632 Nov 02 13:03:31.909216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 471/967] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:31 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:32.276619 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-503edc0a-a0d3-4725-be5e-7b5e543e2d3f req-5ea873bf-172e-4776-8e52-5afb8431c0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895", "name": "network-vif-plugged", "status": "completed", "tag": "c9696789-eadb-4104-9a82-9ae275fb1c40"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:32.286539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-503edc0a-a0d3-4725-be5e-7b5e543e2d3f req-5ea873bf-172e-4776-8e52-5afb8431c0ec service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:32.286972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-503edc0a-a0d3-4725-be5e-7b5e543e2d3f req-5ea873bf-172e-4776-8e52-5afb8431c0ec service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:32.299466 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-503edc0a-a0d3-4725-be5e-7b5e543e2d3f req-5ea873bf-172e-4776-8e52-5afb8431c0ec service nova] Creating event network-vif-plugged:c9696789-eadb-4104-9a82-9ae275fb1c40 for instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 on hv-cinder-86327 Nov 02 13:03:32.304351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-503edc0a-a0d3-4725-be5e-7b5e543e2d3f req-5ea873bf-172e-4776-8e52-5afb8431c0ec service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 Nov 02 13:03:32.304992 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 497/968] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:32.452466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:32.453785 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:32.460474 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:32.461176 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:32.462192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:32.462804 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:32.752024 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:32.752755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:32.760009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:32.760546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:32.761650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:32.762057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:32.909618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:32.917590 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7167c65e-d7e3-4a96-b140-2213347c15ef tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.170017 Nov 02 13:03:32.918162 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 498/969] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:32 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:32.931823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:32.932658 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:32.938920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:32.939365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:32.940134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:32.940564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:33.050643 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:33.059155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:33.061106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:33.062591 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c2f25222-80b5-43a2-bb4c-3621ff8a16f6 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.614076 Nov 02 13:03:33.063192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 472/970] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:32 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:33.081030 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:33.084633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2fb5b576-6c63-4aee-a943-d35036b1c14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.157344 Nov 02 13:03:33.085666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 499/971] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:32 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:33.939954 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:33.940697 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:33.947735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:33.948192 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:33.949003 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:33.949446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:34.089013 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:34.089627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:34.097217 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:34.097763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:34.098788 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:34.099227 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:34.152435 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.161024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-278bced3-5761-40b7-9039-bc5fc13a187d tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.225005 Nov 02 13:03:34.161797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 473/972] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:33 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:34.166688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:34.167313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:34.173929 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:34.174462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:34.175277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:34.175746 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:34.319129 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.327275 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ff7e2037-c9b2-49ad-a0ee-d4f6e5f38095 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.164274 Nov 02 13:03:34.327899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 474/973] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:34 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:34.444861 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.453725 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.455698 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:34.457043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ad6d2e33-1578-4546-a13c-428d399a320f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.372216 Nov 02 13:03:34.457691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 500/974] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:34 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:35.186236 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:35.187558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:35.194770 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:35.195235 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:35.196032 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:35.196504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:35.346278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:35.350640 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:35.351402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:35.353945 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ff516067-2fe2-43a3-ad0e-136c466ebc2e tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.171751 Nov 02 13:03:35.364246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 475/975] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:35 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:35.364474 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:35.364474 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:35.364474 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:35.364474 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:35.488328 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:35.489459 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:35.507678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:35.508128 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:35.509141 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:35.509580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:35.563396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:35.571476 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0a4f737b-325d-4edb-993d-e0d58054027e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.224772 Nov 02 13:03:35.572046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 501/976] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:35 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:35.678144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:35.686676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:35.688177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:35.689387 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f682f95c-0c38-4152-8a18-cb90ef1a4e6e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.209041 Nov 02 13:03:35.689985 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 476/977] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:35 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:36.381704 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:36.382456 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:36.391972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:36.392580 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:36.393741 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:36.394379 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:36.552017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.563241 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f0f0433a-7f8f-4bb8-a1bd-07123e685879 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.187395 Nov 02 13:03:36.565631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 502/978] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:36 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:36.595852 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:36.596538 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:36.604815 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:36.605290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:36.606068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:36.606497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:36.715383 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:36.723484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:36.730008 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:36.730548 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:36.732075 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:36.732627 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:36.778463 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.787409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9e6a8f5f-e8fb-4fb9-8a1d-a40e65fcb4e9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.196526 Nov 02 13:03:36.797781 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 477/979] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:36 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:36.884937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.894375 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.896244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:36.897418 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a7e18daa-c9b6-4912-a276-29efa31351c5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.186268 Nov 02 13:03:36.898025 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 503/980] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:36 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:37.587297 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:37.588181 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:37.595749 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:37.596236 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:37.597038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:37.597713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:37.764892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:37.772640 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-09285850-bfc1-424b-be20-24b83d34a845 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.189391 Nov 02 13:03:37.773447 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 478/981] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:37 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:37.812026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:37.812837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:37.819641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:37.820097 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:37.820914 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:37.821601 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:37.925030 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:37.926276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:37.943846 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:37.944444 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:37.945303 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:37.945810 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:37.976743 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:37.986303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f0bd3064-9804-4c97-9f0a-4b7ae062ac28 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.178758 Nov 02 13:03:37.987204 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 504/982] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:37 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:38.098935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:38.107661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:38.109231 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:38.110563 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3560b88e-c681-4cff-aba1-9d9f68606203 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.191491 Nov 02 13:03:38.111114 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 479/983] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:37 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:38.797380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:38.798121 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:38.805854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:38.806414 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:38.807299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:38.807962 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:38.955467 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:38.963667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ab33852b-df00-4d38-95bd-e29663b6f63a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.171063 Nov 02 13:03:38.973681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 505/984] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:38 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:39.010119 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:39.010749 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:39.017931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:39.018388 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:39.019174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:39.019608 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:39.139649 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:39.140322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:39.146932 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:39.147389 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:39.148191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:39.148662 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:39.189096 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:39.199563 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a35e80e2-8aac-4519-8b33-fa049e0c5c81 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.193279 Nov 02 13:03:39.200653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 480/985] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:39 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:39.345740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:39.358037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:39.359575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:39.360883 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-61ac4e75-978e-4c99-8225-279cd178ce9d tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.225677 Nov 02 13:03:39.361755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 506/986] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:39 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:39.987684 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:39.988379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:39.995340 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:39.995803 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:39.996651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:39.997083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:40.142029 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:40.150980 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5c3ca683-7fed-4ab7-98aa-5511b3b8ccac tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.167521 Nov 02 13:03:40.152233 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 481/987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:39 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:40.223303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:40.225350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:40.232701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:40.233531 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:40.235119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:40.235780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:40.384351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:40.387521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:40.388139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:40.392446 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-11eafdbf-fdde-439c-b39b-9afab394e4e2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.173105 Nov 02 13:03:40.392991 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 507/988] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:40 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:40.394026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:40.394476 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:40.395258 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:40.395691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:40.546191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:40.556625 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:40.558126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:40.559313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd87dc5c-5527-4303-b59d-7c65f5b9f518 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.176159 Nov 02 13:03:40.564896 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 482/989] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:40 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:41.178209 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:41.180316 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:41.188095 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:41.188657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:41.189514 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:41.189958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:41.343357 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.351272 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a426130e-d00c-4e24-89d9-8da76660adab tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.177349 Nov 02 13:03:41.351844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 508/990] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:41 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:41.416403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:41.417081 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:41.423859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:41.424339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:41.425090 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:41.425524 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:41.584975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:41.585604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:41.591613 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:41.592070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:41.592961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:41.593373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:41.601158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.610624 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bc8fe818-4972-4029-87f2-8a30826368a0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.198228 Nov 02 13:03:41.611528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 483/991] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:41 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:41.741750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.750796 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.752322 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:41.753513 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d65d01a8-4f6e-439f-9246-ef467b7f33ea tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.172968 Nov 02 13:03:41.754269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 509/992] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:41 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:42.377005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:42.377725 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:42.384445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:42.384902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:42.385654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:42.386413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:42.531484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.539409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7369c5d3-04e1-48ce-8f67-9ca8f06f5d97 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.167255 Nov 02 13:03:42.539971 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 484/993] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:42 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:42.645585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:42.646697 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:42.653546 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:42.654026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:42.654898 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:42.655395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:42.782613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:42.783430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:42.794396 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:42.795013 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:42.796311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:42.797952 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:42.819090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.827140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-346d1d3a-cc14-4a68-b075-c713aa00b75e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.187734 Nov 02 13:03:42.827753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 510/994] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:42 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:42.960112 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.968611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.970332 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:42.971529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-31ef31cd-3df5-480a-bd0a-248d2d550b66 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.195299 Nov 02 13:03:42.972150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 485/995] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:42 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:43.563954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:43.564621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:43.572129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:43.572656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:43.573436 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:43.574058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:43.729814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:43.738019 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4a34c08f-f4f3-49a3-902d-7d78fa55ac1f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.178781 Nov 02 13:03:43.738811 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 511/996] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:43 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:43.854184 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:43.854825 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:43.861805 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:43.862230 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:43.863015 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:43.863445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:43.998396 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:43.999015 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:44.005281 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:44.005729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:44.006530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:44.007244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:44.015029 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:44.023099 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fa2dd573-e19a-4994-b65d-96b1ad13b3c6 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.173794 Nov 02 13:03:44.023931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 486/997] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:43 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:44.152885 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:44.161083 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:44.162539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:44.164138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f284b12d-6afb-4073-a369-b020402f990a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.169505 Nov 02 13:03:44.164585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 512/998] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:43 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:44.761500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:44.762109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:44.768632 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:44.769058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:44.769848 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:44.770280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:44.924848 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:44.936837 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-eaacda2c-1693-43b4-889a-ea11b009584f tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.179862 Nov 02 13:03:44.937380 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 487/999] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:44 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:45.047269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:45.047865 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:45.055010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:45.055463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:45.056260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:45.056723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:45.190132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:45.190787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:45.197024 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:45.197470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:45.198251 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:45.198678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:45.213092 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:45.221945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-96147b38-8f1b-4a10-a365-d0bc384dabeb tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.178737 Nov 02 13:03:45.222613 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 513/1000] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:45 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:45.342862 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:45.352783 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:45.354307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:45.355489 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4b12485f-7249-4be7-924a-146e6fccb60e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.169667 Nov 02 13:03:45.356055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 488/1001] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:45 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:45.962753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:45.963357 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:45.971273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:45.971728 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:45.972837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:45.973274 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:46.130429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.138755 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cc827b03-fb7f-4e7b-ba0b-b0078348eddc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.182120 Nov 02 13:03:46.139861 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 514/1002] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:45 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:46.247648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:46.248218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:46.255631 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:46.256089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:46.256978 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:46.257417 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:46.381938 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:46.382612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:46.390122 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:46.390762 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:46.391593 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:46.392031 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:46.399205 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.407399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1807c6dd-5492-4c9b-928a-f28d7ddbce79 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.163742 Nov 02 13:03:46.408437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 489/1003] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:46 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:46.534145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.545417 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.547639 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:46.549308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bc7ee122-a2d5-4377-ab06-f7dd3f2e1bb3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.171316 Nov 02 13:03:46.550060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 515/1004] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:46 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:47.162912 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:47.163604 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:47.172882 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:47.173607 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:47.174841 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:47.175420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:47.323033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.334766 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd25b3f9-2aaf-4ac1-a13e-15ef7317d178 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.176282 Nov 02 13:03:47.335529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 490/1005] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:47 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:47.431203 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:47.431803 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:47.439051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:47.439531 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:47.440303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:47.440746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:47.577537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:47.578260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:47.585221 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:47.585898 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:47.587165 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:47.587464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.587662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:47.599679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c365b6f5-1072-410e-b096-45a506814e25 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1357 microversion: 2.1 time: 0.172566 Nov 02 13:03:47.600793 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 516/1006] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:47 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:47.735343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.743558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.745089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:47.746267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-12c481ce-45ad-4627-b466-53ff01875f3a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.173056 Nov 02 13:03:47.746827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 491/1007] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:47 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:48.359854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:48.360150 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:48.369650 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.370103 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.370894 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.371324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.515962 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:48.524175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-976e5928-cdad-4782-92d4-c0b4a9d05976 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.168919 Nov 02 13:03:48.524754 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 517/1008] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:48 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:48.625076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:48.625640 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:48.632245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.632719 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.633497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.633932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.772666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:48.773365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:48.780104 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.780667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.781286 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:48.781463 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.781758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.789119 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bdba7fb6-f3cb-457c-aaa8-d7ac399822bf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1547 microversion: 2.1 time: 0.168729 Nov 02 13:03:48.789735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 492/1009] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:48 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:48.812578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:48.813197 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:48.819497 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.819952 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.820759 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:48.821203 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:48.919869 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:48.928274 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:48.929915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:48.931155 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8363ff32-2079-4560-8bfd-cf4661868bee tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.162554 Nov 02 13:03:48.931718 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 518/1010] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:48 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:48.957510 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:48.965019 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-178bb4b7-cc17-481f-8e3a-0501bd940aaf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1547 microversion: 2.1 time: 0.156437 Nov 02 13:03:48.965587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 493/1011] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:48 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:48.988218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:48.992038 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:48.992847 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Searching by: {'deleted': False, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64'} {{(pid=124277) get_all /opt/stack/nova/nova/compute/api.py:2960}} Nov 02 13:03:49.000059 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.000537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:49.001334 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.001757 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:49.090505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.multi_cell_list [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124277) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:03:49.185977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-95ce0031-d7f3-4ed2-8a5d-dffcb88044f0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202574 Nov 02 13:03:49.186567 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 519/1012] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Nov 2 13:03:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:49.199511 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:49.200136 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:49.207174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.207720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:49.208909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.209569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:49.361158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:49.370276 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ce5803c6-169b-49ec-acae-2ca4e08eea73 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1547 microversion: 2.1 time: 0.175204 Nov 02 13:03:49.370855 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 494/1013] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:49 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:49.550638 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:49.551300 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:49.560358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.561537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:49.561901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.562337 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:49.731394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:49.740404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-be8d0ac4-a2a9-4e4f-bd9a-8547ad5f60f0 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.194916 Nov 02 13:03:49.741255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 520/1014] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:49 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:49.959224 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:49.959842 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:49.966799 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.967249 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:49.968013 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:49.968573 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:50.122964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.131487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.133028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.134210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2f64086d-932a-4aa3-8e3f-d16d48477687 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.180133 Nov 02 13:03:50.134796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 495/1015] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:49 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:50.764633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:50.765248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:50.772157 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:50.772640 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:50.773392 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:50.773831 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:50.923821 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:50.931941 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-36a73a81-34f9-40b8-9ced-ba4af9551102 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.171525 Nov 02 13:03:50.932739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 521/1016] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:50 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:51.024484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-828f1cd9-90fc-4eeb-aa63-5c86825ab14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa242b8f-2188-4e4a-a7e1-a7c713abb4f0"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:51.025838 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-828f1cd9-90fc-4eeb-aa63-5c86825ab14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:51.033279 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-828f1cd9-90fc-4eeb-aa63-5c86825ab14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:51.033974 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-828f1cd9-90fc-4eeb-aa63-5c86825ab14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:51.035062 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-828f1cd9-90fc-4eeb-aa63-5c86825ab14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:51.035542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-828f1cd9-90fc-4eeb-aa63-5c86825ab14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:51.165549 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:51.166293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:51.173205 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:51.173725 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:51.175098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:51.175539 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:51.319727 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-828f1cd9-90fc-4eeb-aa63-5c86825ab14b tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299417 Nov 02 13:03:51.320428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 496/1017] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:03:51 2022] POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:51.338066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:51.348073 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:51.349842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:51.351229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2f85813e-62ca-46f0-8f9c-8ae11d78c1a3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.190904 Nov 02 13:03:51.351867 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 522/1018] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:51 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:51.959146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:51.960141 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:51.970457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:51.970920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:51.971680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:51.972191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:52.117843 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:52.125647 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0f4d0b9f-84fd-481b-80d2-d21812d18dad tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.172327 Nov 02 13:03:52.126218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 497/1019] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:51 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:52.376899 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:52.377782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:52.384390 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:52.384823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:52.385619 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:52.386409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:52.532895 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:52.541457 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:52.543376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:52.544939 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a166edfd-67ec-4017-9b9e-ca2293293142 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.172324 Nov 02 13:03:52.545719 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 523/1020] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:52 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:52.635071 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-b3d99d4f-3e94-4c77-a69d-7e907ca15cdb req-d54e4f21-6452-45fb-8204-dfe7518c1494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754", "name": "network-vif-plugged", "status": "completed", "tag": "8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:52.644026 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-b3d99d4f-3e94-4c77-a69d-7e907ca15cdb req-d54e4f21-6452-45fb-8204-dfe7518c1494 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:52.644506 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-b3d99d4f-3e94-4c77-a69d-7e907ca15cdb req-d54e4f21-6452-45fb-8204-dfe7518c1494 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:52.663034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-b3d99d4f-3e94-4c77-a69d-7e907ca15cdb req-d54e4f21-6452-45fb-8204-dfe7518c1494 service nova] Creating event network-vif-plugged:8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11 for instance 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 on hv-cinder-86327 Nov 02 13:03:52.668175 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-b3d99d4f-3e94-4c77-a69d-7e907ca15cdb req-d54e4f21-6452-45fb-8204-dfe7518c1494 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103424 Nov 02 13:03:52.668826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 498/1021] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:53.150362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:53.151380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:53.157630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:53.158085 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:53.158880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:53.159330 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:53.306166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:53.315132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b4574b69-a2ea-4ced-b329-547356ce49dc tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.168709 Nov 02 13:03:53.315710 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 524/1022] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:53 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:53.573753 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:53.574370 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:53.581304 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:53.581759 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:53.582554 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:53.582994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:53.737183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:53.746504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:53.748463 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:53.750098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-77d7a562-20a0-444a-a624-b810850ce6eb tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.181463 Nov 02 13:03:53.750909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 499/1023] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:53 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:54.346829 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:54.347523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:54.354715 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:54.355160 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:54.355943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:54.356786 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:54.508254 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.517916 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5b255078-2d59-4694-a5f5-5e32dfd78671 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1265 microversion: 2.1 time: 0.175039 Nov 02 13:03:54.518506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 525/1024] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:54 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:54.777249 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:54.777861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:54.785027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:54.785475 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:54.786258 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:54.786698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:54.934396 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.943403 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.944931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:54.946116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cff40d7c-4112-46b6-a934-d16736368476 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.172955 Nov 02 13:03:54.946739 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 500/1025] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:54 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:55.543964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:55.544579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:55.551912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:55.552387 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:55.553191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:55.553613 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:55.697881 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:55.706958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f6fe358d-ab3c-48a2-8efa-0c9097c0fde6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1453 microversion: 2.1 time: 0.168776 Nov 02 13:03:55.707535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 526/1026] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:55 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:55.737578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:55.738098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:55.744688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:55.750333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:55.750333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:55.750333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:55.898893 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:55.909936 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7f56a05f-2fa1-4368-963d-a4e46d34a959 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1453 microversion: 2.1 time: 0.177057 Nov 02 13:03:55.910548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 501/1027] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:55 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:55.971735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:55.972537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:55.978845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:55.979488 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:55.980389 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:55.980906 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:56.166470 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:56.175589 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:56.177150 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:56.178323 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c17c8bcd-ecf7-42e8-8289-acb159a90a9f tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.210922 Nov 02 13:03:56.178883 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 527/1028] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:55 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:56.457122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-f166ef13-9b0d-43c8-8bfd-3d266edb7c42 req-753190cd-17d5-4181-8559-daeb00f53252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cf2036-8434-479c-a251-9f6411e8062a", "name": "network-vif-plugged", "status": "completed", "tag": "d5aae24c-ac0a-4c55-b771-4ccad1cc65ab"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:56.468004 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-f166ef13-9b0d-43c8-8bfd-3d266edb7c42 req-753190cd-17d5-4181-8559-daeb00f53252 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:56.468766 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-f166ef13-9b0d-43c8-8bfd-3d266edb7c42 req-753190cd-17d5-4181-8559-daeb00f53252 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:56.484628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-f166ef13-9b0d-43c8-8bfd-3d266edb7c42 req-753190cd-17d5-4181-8559-daeb00f53252 service nova] Creating event network-vif-plugged:d5aae24c-ac0a-4c55-b771-4ccad1cc65ab for instance 45cf2036-8434-479c-a251-9f6411e8062a on hv-cinder-86327 Nov 02 13:03:56.490443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-f166ef13-9b0d-43c8-8bfd-3d266edb7c42 req-753190cd-17d5-4181-8559-daeb00f53252 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038292 Nov 02 13:03:56.491485 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 502/1029] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:57.205693 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:57.206261 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:57.213130 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:57.213630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:57.214473 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:57.215058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:57.367171 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:57.375983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:57.377702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:57.378933 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3f259d11-dfe2-4c84-bc4f-84cb7aa3a461 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.178064 Nov 02 13:03:57.379483 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 528/1030] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:57 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:03:57.883289 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-32659f4a-a322-4412-879f-f5697232ec75 req-85a1dd52-b705-43be-adf6-28ce80a7c5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754", "tag": "8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:57.892617 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-32659f4a-a322-4412-879f-f5697232ec75 req-85a1dd52-b705-43be-adf6-28ce80a7c5bb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:57.893158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-32659f4a-a322-4412-879f-f5697232ec75 req-85a1dd52-b705-43be-adf6-28ce80a7c5bb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:57.905445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-32659f4a-a322-4412-879f-f5697232ec75 req-85a1dd52-b705-43be-adf6-28ce80a7c5bb service nova] Creating event network-changed:8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11 for instance 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 on hv-cinder-86327 Nov 02 13:03:57.910967 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-32659f4a-a322-4412-879f-f5697232ec75 req-85a1dd52-b705-43be-adf6-28ce80a7c5bb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032627 Nov 02 13:03:57.911724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 503/1031] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:58.407779 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:58.409059 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:58.415684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:58.416155 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:58.416999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:58.417434 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:58.603972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:58.612586 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:58.614094 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:58.615258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-45a976fe-a203-42c8-8edd-d115a1a7de22 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.212094 Nov 02 13:03:58.615826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 529/1032] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:58 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:03:59.658220 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:59.659088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:03:59.666686 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:59.667336 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:03:59.668296 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:03:59.668767 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:00.060503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:00.062058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:00.069980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:00.070928 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:00.072021 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:00.072860 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:00.108158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.117439 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.118955 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.120226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-414369aa-09c0-4094-bca3-68c06f47343e tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1729 microversion: 2.20 time: 0.467481 Nov 02 13:04:00.120886 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 504/1033] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:03:59 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1729 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:04:00.219797 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:00.229804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f7091d28-7ed6-45d5-9e0c-e8fe2191dcad tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1593 microversion: 2.1 time: 0.173580 Nov 02 13:04:00.230585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 530/1034] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:00 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1593 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:01.149742 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:01.150402 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:01.158848 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:01.159428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:01.160515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:01.161139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:01.427029 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:01.437494 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:01.439426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:01.441017 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-495a0049-b6b7-405c-9035-3110942a132a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1716 microversion: 2.20 time: 0.296450 Nov 02 13:04:01.441666 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 505/1035] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:04:01 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1716 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:01.654930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ef08c71a-9d15-424f-a7fd-7b497bf4ae32 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:01.655643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ef08c71a-9d15-424f-a7fd-7b497bf4ae32 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:01.664493 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ef08c71a-9d15-424f-a7fd-7b497bf4ae32 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:01.665114 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ef08c71a-9d15-424f-a7fd-7b497bf4ae32 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:01.666332 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ef08c71a-9d15-424f-a7fd-7b497bf4ae32 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:01.666981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ef08c71a-9d15-424f-a7fd-7b497bf4ae32 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:01.693437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ef08c71a-9d15-424f-a7fd-7b497bf4ae32 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/ips" status: 200 len: 145 microversion: 2.1 time: 0.188508 Nov 02 13:04:01.694063 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 531/1036] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 13:04:01 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/ips => generated 145 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:02.170280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-7bad2d74-64b6-4a5d-bf04-e965cd887e4e req-0c86668e-e1d0-4bb9-b623-9361c87d9646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895", "tag": "c9696789-eadb-4104-9a82-9ae275fb1c40"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:02.181442 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-7bad2d74-64b6-4a5d-bf04-e965cd887e4e req-0c86668e-e1d0-4bb9-b623-9361c87d9646 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:02.182032 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-7bad2d74-64b6-4a5d-bf04-e965cd887e4e req-0c86668e-e1d0-4bb9-b623-9361c87d9646 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:02.195903 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-7bad2d74-64b6-4a5d-bf04-e965cd887e4e req-0c86668e-e1d0-4bb9-b623-9361c87d9646 service nova] Creating event network-changed:c9696789-eadb-4104-9a82-9ae275fb1c40 for instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 on hv-cinder-86327 Nov 02 13:04:02.201515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-7bad2d74-64b6-4a5d-bf04-e965cd887e4e req-0c86668e-e1d0-4bb9-b623-9361c87d9646 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036021 Nov 02 13:04:02.202245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 506/1037] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:03.270631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1735638137"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:03.271841 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:03.278892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:03.279425 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:03.280442 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:03.280882 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:03.423744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.network.security_group_api [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Adding security group 1f7b976e-99c5-4f4a-82b1-a6f3a59b642d to port c9696789-eadb-4104-9a82-9ae275fb1c40 Nov 02 13:04:03.787845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f26f3165-4900-45f7-bcf7-c3ea969b163e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/action" status: 202 len: 0 microversion: 2.1 time: 0.521237 Nov 02 13:04:03.788598 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 532/1038] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 13:04:03 2022] POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:04:03.798366 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:03.799123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:03.806072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:03.806520 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:03.807291 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:03.807721 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:03.823928 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-3cdb3da5-1d17-4a3a-91da-9197448b7c0e req-eafbb14d-4032-45e8-8608-32989708d78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895", "tag": "c9696789-eadb-4104-9a82-9ae275fb1c40"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:03.844963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3cdb3da5-1d17-4a3a-91da-9197448b7c0e req-eafbb14d-4032-45e8-8608-32989708d78e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:03.845405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3cdb3da5-1d17-4a3a-91da-9197448b7c0e req-eafbb14d-4032-45e8-8608-32989708d78e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:03.869746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-3cdb3da5-1d17-4a3a-91da-9197448b7c0e req-eafbb14d-4032-45e8-8608-32989708d78e service nova] Creating event network-changed:c9696789-eadb-4104-9a82-9ae275fb1c40 for instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 on hv-cinder-86327 Nov 02 13:04:03.876760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-3cdb3da5-1d17-4a3a-91da-9197448b7c0e req-eafbb14d-4032-45e8-8608-32989708d78e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060982 Nov 02 13:04:03.879465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 533/1039] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:04.005948 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:04.016779 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9b29a4bf-c666-449b-8d8e-7552e895a4e0 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1759 microversion: 2.1 time: 0.223088 Nov 02 13:04:04.017248 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 507/1040] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:03 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1759 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:04.130281 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3437df26-462e-4243-8262-a6e0754d544d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4db74b53-2928-44d0-8724-0e2d6a95d2d5"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:04.131814 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3437df26-462e-4243-8262-a6e0754d544d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:04.140034 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3437df26-462e-4243-8262-a6e0754d544d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:04.140789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3437df26-462e-4243-8262-a6e0754d544d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:04.141686 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3437df26-462e-4243-8262-a6e0754d544d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:04.142133 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3437df26-462e-4243-8262-a6e0754d544d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:04.455729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3437df26-462e-4243-8262-a6e0754d544d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330403 Nov 02 13:04:04.468741 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 534/1041] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:04:04 2022] POST /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:12.078016 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1da29d4d-a1ee-4358-9137-f4cebedb1167 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:12.079021 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1da29d4d-a1ee-4358-9137-f4cebedb1167 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:12.085501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da29d4d-a1ee-4358-9137-f4cebedb1167 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:12.085950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da29d4d-a1ee-4358-9137-f4cebedb1167 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:12.086710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da29d4d-a1ee-4358-9137-f4cebedb1167 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:12.087140 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1da29d4d-a1ee-4358-9137-f4cebedb1167 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:12.116255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1da29d4d-a1ee-4358-9137-f4cebedb1167 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Nov 02 13:04:12.116830 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 508/1042] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:04:12 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:12.128516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e61b53b5-d780-412f-baaf-30ffcd2d7f89 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:12.129100 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e61b53b5-d780-412f-baaf-30ffcd2d7f89 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:12.136131 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e61b53b5-d780-412f-baaf-30ffcd2d7f89 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:12.136622 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e61b53b5-d780-412f-baaf-30ffcd2d7f89 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:12.137402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e61b53b5-d780-412f-baaf-30ffcd2d7f89 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:12.137845 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e61b53b5-d780-412f-baaf-30ffcd2d7f89 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:12.167408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e61b53b5-d780-412f-baaf-30ffcd2d7f89 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/4db74b53-2928-44d0-8724-0e2d6a95d2d5" status: 200 len: 194 microversion: 2.1 time: 0.043189 Nov 02 13:04:12.168162 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 535/1043] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Nov 2 13:04:12 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/4db74b53-2928-44d0-8724-0e2d6a95d2d5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:13.526902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-07c39f97-eb6d-485c-bd95-a13083c71e80 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81599634-86ef-4122-9081-4b4253e4b770"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:13.528029 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-07c39f97-eb6d-485c-bd95-a13083c71e80 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:13.535087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07c39f97-eb6d-485c-bd95-a13083c71e80 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:13.535541 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07c39f97-eb6d-485c-bd95-a13083c71e80 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:13.536386 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07c39f97-eb6d-485c-bd95-a13083c71e80 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:13.536832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07c39f97-eb6d-485c-bd95-a13083c71e80 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:13.829993 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-07c39f97-eb6d-485c-bd95-a13083c71e80 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "POST /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306999 Nov 02 13:04:13.830662 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 509/1044] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:04:13 2022] POST /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:19.348570 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:04:19.349260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:04:22.466369 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-622be27e-0bd2-4478-9445-db5096ef3ae0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:22.467308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-622be27e-0bd2-4478-9445-db5096ef3ae0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:22.474137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-622be27e-0bd2-4478-9445-db5096ef3ae0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:22.474586 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-622be27e-0bd2-4478-9445-db5096ef3ae0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:22.475356 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-622be27e-0bd2-4478-9445-db5096ef3ae0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:22.475791 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-622be27e-0bd2-4478-9445-db5096ef3ae0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:22.505739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-622be27e-0bd2-4478-9445-db5096ef3ae0 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043242 Nov 02 13:04:22.506262 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 536/1045] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:04:22 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:22.657872 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-415fde75-7aaa-420f-9645-fdb804448e6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:22.658443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-415fde75-7aaa-420f-9645-fdb804448e6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:22.665374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-415fde75-7aaa-420f-9645-fdb804448e6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:22.665847 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-415fde75-7aaa-420f-9645-fdb804448e6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:22.666596 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-415fde75-7aaa-420f-9645-fdb804448e6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:22.667031 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-415fde75-7aaa-420f-9645-fdb804448e6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:22.696554 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-415fde75-7aaa-420f-9645-fdb804448e6c tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/4db74b53-2928-44d0-8724-0e2d6a95d2d5" status: 200 len: 194 microversion: 2.1 time: 0.043127 Nov 02 13:04:22.697149 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 510/1046] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Nov 2 13:04:22 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/4db74b53-2928-44d0-8724-0e2d6a95d2d5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:22.708257 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:22.708778 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:22.715340 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:22.716304 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:22.717193 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:22.717677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:22.799538 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lazy-loading 'services' on Instance uuid 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:04:22.892030 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-de5f11f3-8857-4cc5-b7ae-4a93397d7f1d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/4db74b53-2928-44d0-8724-0e2d6a95d2d5" status: 202 len: 0 microversion: 2.1 time: 0.187598 Nov 02 13:04:22.892739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 537/1047] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:04:22 2022] DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/4db74b53-2928-44d0-8724-0e2d6a95d2d5 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:04:25.093584 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a7bf8cf1-642f-4781-a4e5-5d2b46756875 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:25.094318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a7bf8cf1-642f-4781-a4e5-5d2b46756875 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:25.102626 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7bf8cf1-642f-4781-a4e5-5d2b46756875 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:25.103084 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7bf8cf1-642f-4781-a4e5-5d2b46756875 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:25.103902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7bf8cf1-642f-4781-a4e5-5d2b46756875 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:25.104374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7bf8cf1-642f-4781-a4e5-5d2b46756875 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:25.138197 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a7bf8cf1-642f-4781-a4e5-5d2b46756875 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/81599634-86ef-4122-9081-4b4253e4b770" status: 200 len: 194 microversion: 2.1 time: 0.049943 Nov 02 13:04:25.138878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 511/1048] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Nov 2 13:04:25 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/81599634-86ef-4122-9081-4b4253e4b770 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:25.150906 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:25.151508 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:25.158544 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:25.158994 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:25.159792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:25.160236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:25.244739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lazy-loading 'services' on Instance uuid 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:04:25.319186 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c693593f-7173-43bb-b421-ca06881d5798 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/81599634-86ef-4122-9081-4b4253e4b770" status: 202 len: 0 microversion: 2.1 time: 0.172489 Nov 02 13:04:25.319837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 538/1049] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:04:25 2022] DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments/81599634-86ef-4122-9081-4b4253e4b770 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:04:26.518288 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bc763781-29cd-478a-886a-eade587fba6e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:26.519179 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bc763781-29cd-478a-886a-eade587fba6e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:26.525796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc763781-29cd-478a-886a-eade587fba6e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.526248 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc763781-29cd-478a-886a-eade587fba6e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:26.527203 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc763781-29cd-478a-886a-eade587fba6e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.527675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bc763781-29cd-478a-886a-eade587fba6e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:26.558849 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bc763781-29cd-478a-886a-eade587fba6e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044848 Nov 02 13:04:26.559535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 512/1050] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:04:26 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:04:26.699369 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d67a23b6-712d-4884-a4da-dc1c020ce695 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:26.701630 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d67a23b6-712d-4884-a4da-dc1c020ce695 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:26.714376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d67a23b6-712d-4884-a4da-dc1c020ce695 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.715166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d67a23b6-712d-4884-a4da-dc1c020ce695 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:26.716158 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d67a23b6-712d-4884-a4da-dc1c020ce695 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.716669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d67a23b6-712d-4884-a4da-dc1c020ce695 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:26.756004 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d67a23b6-712d-4884-a4da-dc1c020ce695 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066637 Nov 02 13:04:26.756918 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 539/1051] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:04:26 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:04:26.840933 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:26.841950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:26.849883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.850374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:26.851331 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.851826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:26.887426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:04:26.970923 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f3955f97-b581-4c4a-834a-fbfc459aa76e tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 204 len: 0 microversion: 2.1 time: 0.138311 Nov 02 13:04:26.971906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 513/1052] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:04:26 2022] DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:04:26.984437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:26.985347 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:26.992690 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.993194 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:26.994094 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:26.994574 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:27.149194 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:27.158575 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ee20f215-d10b-495e-a90d-2fbebaca09de tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1674 microversion: 2.1 time: 0.179271 Nov 02 13:04:27.159160 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 540/1053] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:26 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:28.186305 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:28.187173 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:28.193975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:28.194425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:28.195215 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:28.195646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:28.344752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:28.353083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ec06c330-bc2c-4714-b65c-e1c796dbaa8a tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1674 microversion: 2.1 time: 0.173907 Nov 02 13:04:28.354110 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 514/1054] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:28 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:29.379272 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:29.379986 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:29.390798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:29.391254 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:29.392115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:29.392688 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:29.543666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:29.552579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3232b7e8-c626-4609-aed7-08c0baad7020 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1674 microversion: 2.1 time: 0.178966 Nov 02 13:04:29.553175 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 541/1055] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:29 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:30.576919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:30.577613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:30.584246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:30.584703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:30.585490 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:30.585928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:30.655183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a45298a10af4fc3991887cb4da55e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56ac8efe2d4a07aa0f1c7976ad8fe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:30.663847 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fc31c2f5-5fdb-448b-9208-8eb2ae28da99 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 200 len: 1606 microversion: 2.1 time: 0.090883 Nov 02 13:04:30.664613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 515/1056] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:30 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 1606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:30.735002 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-d48628be-9bfb-4522-89a8-f7ce8824dde5 req-86814162-82d1-4de6-9044-fd4936aff60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a", "name": "network-vif-deleted", "tag": "654851c5-9c7f-4ed7-a238-c4cf149d0934"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:30.747399 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-d48628be-9bfb-4522-89a8-f7ce8824dde5 req-86814162-82d1-4de6-9044-fd4936aff60e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:30.749430 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-d48628be-9bfb-4522-89a8-f7ce8824dde5 req-86814162-82d1-4de6-9044-fd4936aff60e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:30.763191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-d48628be-9bfb-4522-89a8-f7ce8824dde5 req-86814162-82d1-4de6-9044-fd4936aff60e service nova] Creating event network-vif-deleted:654851c5-9c7f-4ed7-a238-c4cf149d0934 for instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a on hv-cinder-86327 Nov 02 13:04:30.771407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-d48628be-9bfb-4522-89a8-f7ce8824dde5 req-86814162-82d1-4de6-9044-fd4936aff60e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044986 Nov 02 13:04:30.772453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 542/1057] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:31.691416 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:31.692430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:31.703281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:31.704087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:31.705061 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:31.705725 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:31.723431 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] HTTP exception thrown: Instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a could not be found. Nov 02 13:04:31.724030 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Returning 404 to user: Instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:04:31.724914 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e3c8466-e0dc-4962-99b3-9f322aaec982 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 404 len: 111 microversion: 2.1 time: 0.040787 Nov 02 13:04:31.725499 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 516/1058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:31 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:04:31.735904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-24a3cfb9-0b96-4304-b326-882117aa1d72 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '.version_select at 0x7fbe41ed21f0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:31.757196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-24a3cfb9-0b96-4304-b326-882117aa1d72 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044008374" status: 202 len: 0 microversion: 2.1 time: 0.026286 Nov 02 13:04:31.757777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 543/1059] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Nov 2 13:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044008374 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:04:34.742205 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:34.742920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:34.749639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:34.750343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:34.750885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:34.751573 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:34.766072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] HTTP exception thrown: Instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a could not be found. Nov 02 13:04:34.766072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Returning 404 to user: Instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:04:34.767610 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-25c12be3-315a-4f75-ae37-089aca2e15c2 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 404 len: 111 microversion: 2.1 time: 0.029533 Nov 02 13:04:34.768299 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 517/1060] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:04:34 2022] DELETE /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:04:34.778054 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:34.778868 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:34.786584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:34.787086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:34.787927 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:34.788507 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:34.803644 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] HTTP exception thrown: Instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a could not be found. Nov 02 13:04:34.804337 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Returning 404 to user: Instance 39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:04:34.805215 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-affd7edf-3fb2-4582-a3a8-242a9f8d8d05 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a" status: 404 len: 111 microversion: 2.1 time: 0.032386 Nov 02 13:04:34.805886 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 544/1061] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:34 2022] GET /compute/v2.1/servers/39b4fe2f-41c3-47a2-a832-8b0d55d6bc6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:04:35.966596 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:35.967412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:35.974283 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:35.974737 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:35.975515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:35.975945 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:35.990412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] HTTP exception thrown: Instance ebe9d261-592b-4b69-944d-5517465f6c40 could not be found. Nov 02 13:04:35.991006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Returning 404 to user: Instance ebe9d261-592b-4b69-944d-5517465f6c40 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:04:35.991840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d5775bd1-dd81-41f4-91a9-f91858e85d9d tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 404 len: 111 microversion: 2.1 time: 0.029450 Nov 02 13:04:35.992450 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 518/1062] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:04:35 2022] DELETE /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:04:36.001003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:36.001628 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] [instance: ebe9d261-592b-4b69-944d-5517465f6c40] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:36.008679 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:36.009133 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:36.009921 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:36.010682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:36.025290 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] HTTP exception thrown: Instance ebe9d261-592b-4b69-944d-5517465f6c40 could not be found. Nov 02 13:04:36.025975 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] Returning 404 to user: Instance ebe9d261-592b-4b69-944d-5517465f6c40 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:04:36.026735 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4a3eb10d-abcc-48ec-82b6-c6b7ad3d5966 tempest-AttachVolumeTestJSON-805691609 tempest-AttachVolumeTestJSON-805691609-project] 10.222.0.90 "GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40" status: 404 len: 111 microversion: 2.1 time: 0.029849 Nov 02 13:04:36.027312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 545/1063] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:35 2022] GET /compute/v2.1/servers/ebe9d261-592b-4b69-944d-5517465f6c40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:04:45.210234 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2e060b12-69b3-4e7f-b16b-02b0ec49e9a9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: .version_select at 0x7fbe42785040>, body: {"keypair": {"name": "tempest-keypair-2027596307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQwlRLdcQKICIAA/eF7tEY0CUjH75lY3PdrLGboa0tL3VnhiopsygEvHzcHD4kdFgE+ZWBqRMTTseXbgFJ5HpzjmXVM0sHaGjF4HGa3EZjhX48+SZqtegUltJUi21b4NA=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:45.224676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-2e060b12-69b3-4e7f-b16b-02b0ec49e9a9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:04:45.228814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-2e060b12-69b3-4e7f-b16b-02b0ec49e9a9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:04:45.259270 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2e060b12-69b3-4e7f-b16b-02b0ec49e9a9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183549 Nov 02 13:04:45.266896 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 519/1064] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 13:04:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:46.617884 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-894712572", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46222446-e421-4f44-b970-f0c2d05a9631"}], "security_groups": [{"name": "tempest-securitygroup--1436843570"}], "key_name": "tempest-keypair-2027596307", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:46.731584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] validate_networks() for [('46222446-e421-4f44-b970-f0c2d05a9631', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:04:47.179214 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:04:47.179813 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:04:47.180718 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:04:47.181124 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:04:47.181551 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:04:47.192252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:47.192704 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:47.193511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:47.193943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:47.210716 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:04:47.214763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:04:47.226358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:04:47.228764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:04:47.280140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9d6a3caa-acf9-452e-a2ea-64733044c8f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666781 Nov 02 13:04:47.281192 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 546/1065] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:04:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:04:47.294913 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fee1259e-e5a2-4ac0-90b4-2b2ee28e0270 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:47.295553 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fee1259e-e5a2-4ac0-90b4-2b2ee28e0270 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:47.369461 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fee1259e-e5a2-4ac0-90b4-2b2ee28e0270 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:47.379555 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fee1259e-e5a2-4ac0-90b4-2b2ee28e0270 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1241 microversion: 2.1 time: 0.088602 Nov 02 13:04:47.380890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 520/1066] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:47 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:48.405370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:48.406101 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:48.414387 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:48.415188 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:48.416000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:48.416483 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:48.481558 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:48.489912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-161a7151-af7a-437a-b2a9-c808a1a63d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1293 microversion: 2.1 time: 0.089305 Nov 02 13:04:48.490518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 547/1067] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:48 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:49.516018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:49.518075 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:49.526764 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:49.527470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:49.528598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:49.529725 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:49.791407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:49.799840 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e9af46e0-5503-4540-832e-99cb959e6511 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.288233 Nov 02 13:04:49.800558 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 521/1068] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:49 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:50.068055 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-80b0761c-996a-4d0b-8bcd-0d1220f56fbf req-11bfed50-c834-42d4-838b-523c16c2bfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6f26a5-a573-4de6-8bfa-8d10d473bd43", "tag": "c70cb391-0da9-4166-9cc2-6633f6288a40"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:50.079641 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-80b0761c-996a-4d0b-8bcd-0d1220f56fbf req-11bfed50-c834-42d4-838b-523c16c2bfd9 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:50.080065 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-80b0761c-996a-4d0b-8bcd-0d1220f56fbf req-11bfed50-c834-42d4-838b-523c16c2bfd9 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:50.092164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-80b0761c-996a-4d0b-8bcd-0d1220f56fbf req-11bfed50-c834-42d4-838b-523c16c2bfd9 service nova] Creating event network-changed:c70cb391-0da9-4166-9cc2-6633f6288a40 for instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 on hv-cinder-86327 Nov 02 13:04:50.097621 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-80b0761c-996a-4d0b-8bcd-0d1220f56fbf req-11bfed50-c834-42d4-838b-523c16c2bfd9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033518 Nov 02 13:04:50.098207 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 548/1069] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:50.824268 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:50.825254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:50.833460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:50.833925 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:50.834932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:50.835367 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:51.042397 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:51.050491 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-41c12f3a-d1d3-4f38-8689-0e9675ed122c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.230227 Nov 02 13:04:51.051079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 522/1070] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:50 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:52.076665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:52.077464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:52.086029 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:52.086681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:52.087670 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:52.088262 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:52.233875 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:52.241780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-937f6eb8-7e49-425c-a1e8-563f495d12ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.170756 Nov 02 13:04:52.242345 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 549/1071] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:52 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:53.265525 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:53.266222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:53.273501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:53.273957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:53.274716 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:53.275149 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:53.421722 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:53.433609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e2c2b600-fb82-4037-a091-7999c070ac77 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.172227 Nov 02 13:04:53.435126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 523/1072] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:53 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:54.459365 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:54.460343 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:54.467447 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:54.467932 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:54.468771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:54.469221 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:54.612981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:54.620477 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-06ee72ad-0763-41d4-b477-3e454f5bd8f5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.165180 Nov 02 13:04:54.621037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 550/1073] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:54 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:55.647787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:55.648445 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:55.658312 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:55.658769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:55.659547 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:55.659982 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:55.822038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:55.832128 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-266cd7db-648b-4f86-bfdc-7db1aa569487 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.190751 Nov 02 13:04:55.832790 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 524/1074] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:55 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:56.737748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-35f40eff-7cfc-4de4-994d-33feeafa92ee req-379c4a9e-f115-4682-81c1-d3f14abd2adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6f26a5-a573-4de6-8bfa-8d10d473bd43", "name": "network-vif-plugged", "status": "completed", "tag": "c70cb391-0da9-4166-9cc2-6633f6288a40"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:56.747582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-35f40eff-7cfc-4de4-994d-33feeafa92ee req-379c4a9e-f115-4682-81c1-d3f14abd2adb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:56.748295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-35f40eff-7cfc-4de4-994d-33feeafa92ee req-379c4a9e-f115-4682-81c1-d3f14abd2adb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:56.761346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-35f40eff-7cfc-4de4-994d-33feeafa92ee req-379c4a9e-f115-4682-81c1-d3f14abd2adb service nova] Creating event network-vif-plugged:c70cb391-0da9-4166-9cc2-6633f6288a40 for instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 on hv-cinder-86327 Nov 02 13:04:56.766904 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-35f40eff-7cfc-4de4-994d-33feeafa92ee req-379c4a9e-f115-4682-81c1-d3f14abd2adb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Nov 02 13:04:56.767963 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 551/1075] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:56.856651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:56.857316 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:56.864097 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:56.864653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:56.865447 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:56.865880 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:57.053525 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:57.061333 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1766892d-f9a1-438b-9c5c-cf5cba5ce44c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.208892 Nov 02 13:04:57.061922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 525/1076] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:56 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:58.085756 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:58.086336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:58.093624 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:58.094086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:58.094871 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:58.095363 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:58.245780 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:58.253964 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e58c77d4-a89c-490f-905d-00dd89d8612e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1367 microversion: 2.1 time: 0.172907 Nov 02 13:04:58.254523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 552/1077] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:58 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:59.280414 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:59.281139 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:59.287902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:59.288390 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:59.289159 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:59.289585 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:59.437917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:59.451743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bea67fc7-c06b-42e8-b367-ef37ccbabf1a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1557 microversion: 2.1 time: 0.175367 Nov 02 13:04:59.452371 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 526/1078] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:59 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1557 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:59.476445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bc88331a-d6fd-446b-a5df-55b177d854e4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:59.476959 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bc88331a-d6fd-446b-a5df-55b177d854e4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:04:59.485484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc88331a-d6fd-446b-a5df-55b177d854e4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:59.485931 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc88331a-d6fd-446b-a5df-55b177d854e4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:59.487231 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc88331a-d6fd-446b-a5df-55b177d854e4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:04:59.487841 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc88331a-d6fd-446b-a5df-55b177d854e4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:04:59.577269 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bc88331a-d6fd-446b-a5df-55b177d854e4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104879 Nov 02 13:04:59.577920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 553/1079] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 13:04:59 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:00.748613 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-2c0f168f-f856-4e33-acca-a1f3f75875f7 req-6f98bd58-4278-4811-b47f-553db536adba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6f26a5-a573-4de6-8bfa-8d10d473bd43", "tag": "c70cb391-0da9-4166-9cc2-6633f6288a40"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:00.757672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-2c0f168f-f856-4e33-acca-a1f3f75875f7 req-6f98bd58-4278-4811-b47f-553db536adba service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:00.758132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-2c0f168f-f856-4e33-acca-a1f3f75875f7 req-6f98bd58-4278-4811-b47f-553db536adba service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:00.770549 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-2c0f168f-f856-4e33-acca-a1f3f75875f7 req-6f98bd58-4278-4811-b47f-553db536adba service nova] Creating event network-changed:c70cb391-0da9-4166-9cc2-6633f6288a40 for instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 on hv-cinder-86327 Nov 02 13:05:00.775832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-2c0f168f-f856-4e33-acca-a1f3f75875f7 req-6f98bd58-4278-4811-b47f-553db536adba service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031113 Nov 02 13:05:00.776653 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 527/1080] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:15.099172 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c24995ba-3d19-4e45-b1a7-e103be4c94d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:15.100805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c24995ba-3d19-4e45-b1a7-e103be4c94d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:15.110615 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c24995ba-3d19-4e45-b1a7-e103be4c94d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:15.111048 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c24995ba-3d19-4e45-b1a7-e103be4c94d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:15.111865 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c24995ba-3d19-4e45-b1a7-e103be4c94d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:15.112318 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c24995ba-3d19-4e45-b1a7-e103be4c94d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:15.190893 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c24995ba-3d19-4e45-b1a7-e103be4c94d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/action" status: 202 len: 0 microversion: 2.1 time: 0.098893 Nov 02 13:05:15.191633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 554/1081] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 13:05:15 2022] POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:05:15.206556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:15.207588 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:15.217181 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:15.217640 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:15.218432 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:15.219040 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:15.423432 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:15.432998 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8dee4614-bb73-41b8-b0af-7ecbc98ab5cd tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1751 microversion: 2.1 time: 0.234647 Nov 02 13:05:15.433609 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 528/1082] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:15 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1751 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:16.459651 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:16.460408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:16.467505 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:16.467961 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:16.468800 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:16.469248 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:16.634376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:16.647858 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-12ecf5d4-9223-4262-9b78-0c57e269b8a9 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.192757 Nov 02 13:05:16.648722 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 555/1083] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:16 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:17.677113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:17.677960 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:17.687627 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:17.688365 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:17.689362 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:17.689779 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:17.853587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:17.862587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dfe91a74-4ada-4c1e-be29-79f66ffe21ac tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.191302 Nov 02 13:05:17.863170 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 529/1084] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:17 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:18.059273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4d0df8b3-d606-4493-bd86-bb9760019eb5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:18.060912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4d0df8b3-d606-4493-bd86-bb9760019eb5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:18.069405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d0df8b3-d606-4493-bd86-bb9760019eb5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.069857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d0df8b3-d606-4493-bd86-bb9760019eb5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:18.070637 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d0df8b3-d606-4493-bd86-bb9760019eb5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.071070 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d0df8b3-d606-4493-bd86-bb9760019eb5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:18.100994 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4d0df8b3-d606-4493-bd86-bb9760019eb5 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048659 Nov 02 13:05:18.101893 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 556/1085] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Nov 2 13:05:18 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:18.177836 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:18.178336 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:18.185006 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.185460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:18.186248 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.186671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:18.213379 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:05:18.297536 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-979cc923-386e-44d8-b7f9-76494612c85a tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 204 len: 0 microversion: 2.20 time: 0.124985 Nov 02 13:05:18.298239 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 530/1086] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Nov 2 13:05:18 2022] DELETE /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:05:18.308387 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:18.309033 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:18.315879 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.316426 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:18.317216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.317661 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:18.465584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:18.477891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:18.480332 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:18.482407 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b505bab5-1eb9-4222-b4ce-43bacaba64e8 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.178071 Nov 02 13:05:18.483281 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 557/1087] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:18 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:18.899892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:18.900669 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:18.910928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.911384 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:18.912174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:18.912646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:19.104212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:19.114304 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e2e4516-491c-4047-bcad-6c23348c7034 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.221859 Nov 02 13:05:19.114928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 531/1088] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:18 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:19.525098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:19.525770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:19.533265 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:19.533773 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:19.534631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:19.535098 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:19.683071 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:19.692552 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:19.694060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:19.695267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-25c4e658-9ba5-48f7-ad9c-b7e3270e19f3 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.174548 Nov 02 13:05:19.695887 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 558/1089] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:19 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:20.145487 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:20.146474 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:20.157566 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:20.158409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:20.159715 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:20.160848 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:20.361910 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:20.370826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-135be085-8bd2-4389-94b7-667d4adb8cea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.230852 Nov 02 13:05:20.371717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 532/1090] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:20 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:20.723255 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:20.723857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:20.730840 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:20.731295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:20.732094 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:20.732817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:20.875954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:20.884555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:20.886457 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:20.887666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b36a01a7-6d59-4e1b-98a9-0249ee733e40 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1722 microversion: 2.20 time: 0.168922 Nov 02 13:05:20.888385 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 559/1091] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:20 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:21.366150 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-77ca457a-cebb-47a4-8de1-c835f084a041 req-59e1371a-d540-4dce-9267-2b7b4abf8e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cf2036-8434-479c-a251-9f6411e8062a", "name": "network-vif-deleted", "tag": "d5aae24c-ac0a-4c55-b771-4ccad1cc65ab"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:21.378338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-77ca457a-cebb-47a4-8de1-c835f084a041 req-59e1371a-d540-4dce-9267-2b7b4abf8e6f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:21.378869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-77ca457a-cebb-47a4-8de1-c835f084a041 req-59e1371a-d540-4dce-9267-2b7b4abf8e6f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:21.392565 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-77ca457a-cebb-47a4-8de1-c835f084a041 req-59e1371a-d540-4dce-9267-2b7b4abf8e6f service nova] Creating event network-vif-deleted:d5aae24c-ac0a-4c55-b771-4ccad1cc65ab for instance 45cf2036-8434-479c-a251-9f6411e8062a on hv-cinder-86327 Nov 02 13:05:21.396716 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:21.397349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:21.404926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-77ca457a-cebb-47a4-8de1-c835f084a041 req-59e1371a-d540-4dce-9267-2b7b4abf8e6f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042888 Nov 02 13:05:21.405556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 533/1092] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:21.411167 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:21.411892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:21.412926 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:21.413448 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:21.594589 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:21.602803 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2a0b3b98-5a85-4d27-bc35-7d2c41502881 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.210648 Nov 02 13:05:21.603632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 560/1093] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:21 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:21.914998 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:21.915999 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:21.923111 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:21.923868 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:21.924710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:21.925149 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:21.956694 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:21.957158 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:21.957619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lazy-loading 'fault' on Instance uuid 45cf2036-8434-479c-a251-9f6411e8062a {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:05:22.010053 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:22.019001 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:22.020994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2c786462bac45848eeff3a966e71149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf71ef682d140f9b9c9c756b24cbb5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:22.022271 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f1ed4af6-f80c-4c86-9919-e528fa2d6bd1 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 200 len: 1370 microversion: 2.20 time: 0.111900 Nov 02 13:05:22.022917 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 534/1094] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:21 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:05:22.626305 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:22.626926 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:22.633980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:22.634434 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:22.635573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:22.636012 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:22.804235 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:22.812874 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-724995af-1396-4596-9236-787e7b7fa9d2 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.190731 Nov 02 13:05:22.813481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 561/1095] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:22 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:23.057210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:23.057788 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:23.064861 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:23.065289 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:23.066089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:23.066522 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:23.081741 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] HTTP exception thrown: Instance 45cf2036-8434-479c-a251-9f6411e8062a could not be found. Nov 02 13:05:23.082368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Returning 404 to user: Instance 45cf2036-8434-479c-a251-9f6411e8062a could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:05:23.083210 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c3e87c8a-4ade-4b63-b7cd-040bd5821834 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 404 len: 111 microversion: 2.20 time: 0.030098 Nov 02 13:05:23.083773 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 535/1096] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:23 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:05:23.093030 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6cdac353-651e-426e-b01f-7c2194806fe0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '.version_select at 0x7fbe41f718b0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:23.114507 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6cdac353-651e-426e-b01f-7c2194806fe0 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46503764" status: 204 len: 0 microversion: 2.20 time: 0.025802 Nov 02 13:05:23.115082 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 562/1097] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Nov 2 13:05:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46503764 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:05:23.837792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:23.838735 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:23.846014 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:23.846454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:23.847277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:23.847713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:24.017395 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:24.026093 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-87d2127f-7e77-4068-bfca-92e2ae77dc1e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.192324 Nov 02 13:05:24.026663 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 536/1098] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:23 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:24.957948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:24.958557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:24.965123 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:24.966304 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:24.966459 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:24.966959 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:24.982105 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] HTTP exception thrown: Instance 45cf2036-8434-479c-a251-9f6411e8062a could not be found. Nov 02 13:05:24.982698 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Returning 404 to user: Instance 45cf2036-8434-479c-a251-9f6411e8062a could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:05:24.983573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b4f035e7-5e7d-482c-b65a-ba325ab5018b tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 404 len: 111 microversion: 2.20 time: 0.030347 Nov 02 13:05:24.984134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 563/1099] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Nov 2 13:05:24 2022] DELETE /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:05:24.992724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:24.993362 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 45cf2036-8434-479c-a251-9f6411e8062a] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:25.001924 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:25.002747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:25.004127 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:25.004667 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:25.020124 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] HTTP exception thrown: Instance 45cf2036-8434-479c-a251-9f6411e8062a could not be found. Nov 02 13:05:25.020776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Returning 404 to user: Instance 45cf2036-8434-479c-a251-9f6411e8062a could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:05:25.021628 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ab1e7845-7d38-40c2-acbb-c56c0eca52a4 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a" status: 404 len: 111 microversion: 2.20 time: 0.033008 Nov 02 13:05:25.022191 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 537/1100] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:24 2022] GET /compute/v2.1/servers/45cf2036-8434-479c-a251-9f6411e8062a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:05:25.050724 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:25.051364 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:25.057863 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:25.058317 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:25.059449 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:25.060362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:25.234901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:25.244001 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8f043764-4f55-4044-ad2a-4b65c8be21d5 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.197483 Nov 02 13:05:25.244637 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 564/1101] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:25 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:26.193399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:26.194218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:26.201132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:26.201563 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:26.202623 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:26.203214 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:26.218434 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] HTTP exception thrown: Instance 1839881d-97b0-4aa7-b398-2eeee344099f could not be found. Nov 02 13:05:26.219039 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Returning 404 to user: Instance 1839881d-97b0-4aa7-b398-2eeee344099f could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:05:26.220556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-77595280-abfd-4951-9416-cc5613e7ce85 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 404 len: 111 microversion: 2.20 time: 0.032097 Nov 02 13:05:26.220556 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 538/1102] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Nov 2 13:05:26 2022] DELETE /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:05:26.229685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:26.230300 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] [instance: 1839881d-97b0-4aa7-b398-2eeee344099f] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:26.237237 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:26.237684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:26.238631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:26.239049 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:26.263807 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] HTTP exception thrown: Instance 1839881d-97b0-4aa7-b398-2eeee344099f could not be found. Nov 02 13:05:26.264985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] Returning 404 to user: Instance 1839881d-97b0-4aa7-b398-2eeee344099f could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:05:26.266486 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d81a477a-866d-44c3-bac3-67daa2b45b44 tempest-AttachVolumeShelveTestJSON-1273951611 tempest-AttachVolumeShelveTestJSON-1273951611-project] 10.222.0.90 "GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f" status: 404 len: 111 microversion: 2.20 time: 0.040736 Nov 02 13:05:26.267107 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 565/1103] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Nov 2 13:05:26 2022] GET /compute/v2.1/servers/1839881d-97b0-4aa7-b398-2eeee344099f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:05:26.272596 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:26.272596 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:26.282585 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:26.283760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:26.284122 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:26.284710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:26.613407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:26.622983 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a03003f5-20c0-4b15-9d87-14fab458348d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1756 microversion: 2.1 time: 0.358082 Nov 02 13:05:26.623926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 539/1104] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:26 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1756 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:27.649025 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:27.649690 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:05:27.656842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:27.657307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:27.658118 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:05:27.658559 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:05:27.823750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:27.832911 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a9f85727-9618-4210-9986-899990692614 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1759 microversion: 2.1 time: 0.187980 Nov 02 13:05:27.833503 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 566/1105] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:27 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:31.037942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1aa3f8a0-1d34-4e01-ac66-97583f3976d9 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Action: 'create', calling method: .version_select at 0x7fbe427908b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-839806098", "metadata": {"Type": "work"}}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:31.371503 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1aa3f8a0-1d34-4e01-ac66-97583f3976d9 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.471612 Nov 02 13:05:31.372254 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 540/1106] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Nov 2 13:05:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 473 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 13:05:31.385934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ac868415-0f9c-4f73-912b-cd2b7bfe7747 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Calling method '.version_select at 0x7fbe41da40d0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:31.440173 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ac868415-0f9c-4f73-912b-cd2b7bfe7747 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0" status: 200 len: 352 microversion: 2.1 time: 0.058290 Nov 02 13:05:31.441258 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 567/1107] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 13:05:31 2022] GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:32.455827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd6b7a6b-230b-400f-b130-c01162162946 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Calling method '.version_select at 0x7fbe42795820>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:32.505787 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd6b7a6b-230b-400f-b130-c01162162946 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0" status: 200 len: 353 microversion: 2.1 time: 0.054284 Nov 02 13:05:32.506347 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 541/1108] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 13:05:32 2022] GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:32.520288 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cc051a47-6f4a-45f4-9fe1-8da0604ce6e5 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Calling method '.version_select at 0x7fbe41f718b0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:32.567009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cc051a47-6f4a-45f4-9fe1-8da0604ce6e5 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0" status: 200 len: 353 microversion: 2.1 time: 0.051015 Nov 02 13:05:32.567603 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 568/1109] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 13:05:32 2022] GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:32.586206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-99bd469f-028d-4091-b403-ba2901147ee0 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Calling method '.version_select at 0x7fbe444abaf0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:32.656773 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-99bd469f-028d-4091-b403-ba2901147ee0 tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0" status: 202 len: 0 microversion: 2.1 time: 0.074461 Nov 02 13:05:32.660377 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 542/1110] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 13:05:32 2022] DELETE /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:05:32.665812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-904291c5-6bed-402e-a8a1-2fae27ba741a tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Calling method '.version_select at 0x7fbe41ffc040>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:32.714438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-904291c5-6bed-402e-a8a1-2fae27ba741a tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0" status: 200 len: 352 microversion: 2.1 time: 0.052587 Nov 02 13:05:32.715244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 569/1111] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 13:05:32 2022] GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:33.734413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-270cf80c-f39b-4f82-82d9-90ce7ce5390e tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Calling method '.version_select at 0x7fbe427951f0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:33.770060 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-270cf80c-f39b-4f82-82d9-90ce7ce5390e tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] HTTP exception thrown: Volume f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 could not be found. Nov 02 13:05:33.770686 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-270cf80c-f39b-4f82-82d9-90ce7ce5390e tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] Returning 404 to user: Volume f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:05:33.771518 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-270cf80c-f39b-4f82-82d9-90ce7ce5390e tempest-VolumesGetTestJSON-255356080 tempest-VolumesGetTestJSON-255356080-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0" status: 404 len: 109 microversion: 2.1 time: 0.044485 Nov 02 13:05:33.772027 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 543/1112] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Nov 2 13:05:33 2022] GET /compute/v2.1/os-volumes/f7db88c6-f936-4ab0-84a0-0679aa6f1ab0 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:01.972619 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:01.973224 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:01.974559 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-1e4a1274-3b31-49ea-90b6-eb0553884830 req-f0172f2a-cab3-44f8-a9f2-b47625dbe32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754", "tag": "8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:01.980219 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:01.980930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:01.982156 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:01.982930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:01.984671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-1e4a1274-3b31-49ea-90b6-eb0553884830 req-f0172f2a-cab3-44f8-a9f2-b47625dbe32e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:01.985332 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-1e4a1274-3b31-49ea-90b6-eb0553884830 req-f0172f2a-cab3-44f8-a9f2-b47625dbe32e service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:01.996815 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-1e4a1274-3b31-49ea-90b6-eb0553884830 req-f0172f2a-cab3-44f8-a9f2-b47625dbe32e service nova] Creating event network-changed:8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11 for instance 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 on hv-cinder-86327 Nov 02 13:06:02.002782 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-1e4a1274-3b31-49ea-90b6-eb0553884830 req-f0172f2a-cab3-44f8-a9f2-b47625dbe32e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033304 Nov 02 13:06:02.003643 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 544/1113] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:02.011446 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:06:02.131359 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5a440736-f4e9-46a1-a32a-7be1f14dc03a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 204 len: 0 microversion: 2.1 time: 0.163691 Nov 02 13:06:02.131977 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 570/1114] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:01 2022] DELETE /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:06:02.141195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:02.141906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:02.148193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:02.148681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:02.149464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:02.149918 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:02.409649 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:02.425446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bce4491e-7ecb-4aa3-9300-180d19117941 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1578 microversion: 2.1 time: 0.288012 Nov 02 13:06:02.426460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 545/1115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:02 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1578 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:02.498979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:06:02.499261 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:06:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:06:03.456383 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:03.457064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:03.464308 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:03.464762 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:03.465557 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:03.465989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:03.614746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:03.623464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8500b4e7-111c-45bb-aefd-f418a568fca1 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1459 microversion: 2.1 time: 0.171559 Nov 02 13:06:03.624028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 571/1116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:03 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:04.651714 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:04.652364 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:04.659425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:04.659949 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:04.660786 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:04.661222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:04.893078 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:04.901437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4e5bdef2-120f-42c1-8111-bb26fcd2953b tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1459 microversion: 2.1 time: 0.253808 Nov 02 13:06:04.902032 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 546/1117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:04 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1459 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:05.254785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-5e99d349-2bed-4260-9831-46b2bd501fdb req-fcde912a-c72d-45f9-b0fb-4fed48a3002b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754", "name": "network-vif-deleted", "tag": "8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:05.265573 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5e99d349-2bed-4260-9831-46b2bd501fdb req-fcde912a-c72d-45f9-b0fb-4fed48a3002b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:05.266307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5e99d349-2bed-4260-9831-46b2bd501fdb req-fcde912a-c72d-45f9-b0fb-4fed48a3002b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:05.279023 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-5e99d349-2bed-4260-9831-46b2bd501fdb req-fcde912a-c72d-45f9-b0fb-4fed48a3002b service nova] Creating event network-vif-deleted:8c101d8f-3b0e-437a-9dcf-0e29a8ccbc11 for instance 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 on hv-cinder-86327 Nov 02 13:06:05.285352 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-5e99d349-2bed-4260-9831-46b2bd501fdb req-fcde912a-c72d-45f9-b0fb-4fed48a3002b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Nov 02 13:06:05.286231 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 572/1118] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:05.926433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:05.927015 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:05.934310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:05.934310 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:05.935035 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:05.935463 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:05.965930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:05.966371 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:05.966807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lazy-loading 'fault' on Instance uuid 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:06:06.008045 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:06.016603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-200ca95f-ceed-48d1-92c1-2805dc220a43 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 200 len: 1230 microversion: 2.1 time: 0.094089 Nov 02 13:06:06.017510 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 547/1119] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:05 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:07.041739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:07.042695 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:07.050189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:07.050633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:07.051405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:07.051834 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:07.065772 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] HTTP exception thrown: Instance 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 could not be found. Nov 02 13:06:07.066359 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Returning 404 to user: Instance 7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:06:07.067346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bbcb4a2a-2bf2-4025-a817-ce0c0f95a0e7 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754" status: 404 len: 111 microversion: 2.1 time: 0.030195 Nov 02 13:06:07.067884 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 573/1120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:07 2022] GET /compute/v2.1/servers/7bc8d2b0-4fc5-4af0-84b4-a5d4e2cf3754 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:10.243078 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:10.244654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:10.252548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:10.253002 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:10.253904 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:10.254352 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:10.283639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:06:10.377174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b9f72b95-ac82-4b09-9173-37113afac8e6 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 204 len: 0 microversion: 2.1 time: 0.137603 Nov 02 13:06:10.379504 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 548/1121] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:10 2022] DELETE /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:06:10.388671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-c0ce8e4c-50de-4733-8ec7-1dae71b30059 req-3ae1f7b6-968b-4d71-8541-d56b51c444b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3a70f5-7a54-4a66-b099-dcf84affc11d", "tag": "9ee660ea-c2fa-4fab-a75e-65370edd6b07"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:10.391407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:10.392321 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:10.398126 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c0ce8e4c-50de-4733-8ec7-1dae71b30059 req-3ae1f7b6-968b-4d71-8541-d56b51c444b3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:10.398644 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c0ce8e4c-50de-4733-8ec7-1dae71b30059 req-3ae1f7b6-968b-4d71-8541-d56b51c444b3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:10.398829 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:10.399167 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:10.399955 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:10.400437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:10.415404 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-c0ce8e4c-50de-4733-8ec7-1dae71b30059 req-3ae1f7b6-968b-4d71-8541-d56b51c444b3 service nova] Creating event network-changed:9ee660ea-c2fa-4fab-a75e-65370edd6b07 for instance ed3a70f5-7a54-4a66-b099-dcf84affc11d on hv-cinder-86327 Nov 02 13:06:10.421782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-c0ce8e4c-50de-4733-8ec7-1dae71b30059 req-3ae1f7b6-968b-4d71-8541-d56b51c444b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179056 Nov 02 13:06:10.422750 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 574/1122] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:10.586329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:10.594332 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9d06fd94-d2d6-499d-b52c-06a74414dbea tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1579 microversion: 2.1 time: 0.209875 Nov 02 13:06:10.595224 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 549/1123] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:10 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1579 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:11.642295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:11.643371 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:11.651829 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:11.652344 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:11.653501 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:11.654110 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:11.798201 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:11.806805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-982ef907-c61f-4ce2-a7aa-fcc145e0b511 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1460 microversion: 2.1 time: 0.172831 Nov 02 13:06:11.807363 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 575/1124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:11 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1460 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:12.196098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-8798aabd-ac56-4b5d-8e7a-9a94b214f82b req-09d728a2-9bcd-49dd-9e2b-30c27e81372c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3a70f5-7a54-4a66-b099-dcf84affc11d", "name": "network-vif-deleted", "tag": "9ee660ea-c2fa-4fab-a75e-65370edd6b07"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:12.208869 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8798aabd-ac56-4b5d-8e7a-9a94b214f82b req-09d728a2-9bcd-49dd-9e2b-30c27e81372c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:12.209365 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8798aabd-ac56-4b5d-8e7a-9a94b214f82b req-09d728a2-9bcd-49dd-9e2b-30c27e81372c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:12.225383 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-8798aabd-ac56-4b5d-8e7a-9a94b214f82b req-09d728a2-9bcd-49dd-9e2b-30c27e81372c service nova] Creating event network-vif-deleted:9ee660ea-c2fa-4fab-a75e-65370edd6b07 for instance ed3a70f5-7a54-4a66-b099-dcf84affc11d on hv-cinder-86327 Nov 02 13:06:12.230734 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-8798aabd-ac56-4b5d-8e7a-9a94b214f82b req-09d728a2-9bcd-49dd-9e2b-30c27e81372c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038733 Nov 02 13:06:12.231484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 550/1125] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:12.833337 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:12.834099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:12.841291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:12.841584 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:12.842376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:12.842812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:12.876223 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:12.876681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:12.877127 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lazy-loading 'fault' on Instance uuid ed3a70f5-7a54-4a66-b099-dcf84affc11d {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:06:12.928299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c01ed6e76ef4ee4ba5356c526e113e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ffa8215f4d6479babed8b59e14b7e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:12.936236 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-69d43ee0-c86c-44c8-9c4a-b3521a105ffb tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 200 len: 1231 microversion: 2.1 time: 0.106921 Nov 02 13:06:12.936801 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 576/1126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:12 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:13.964550 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:13.965226 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: ed3a70f5-7a54-4a66-b099-dcf84affc11d] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:13.971724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:13.972174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:13.972989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:13.973422 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:13.992345 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] HTTP exception thrown: Instance ed3a70f5-7a54-4a66-b099-dcf84affc11d could not be found. Nov 02 13:06:13.993033 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Returning 404 to user: Instance ed3a70f5-7a54-4a66-b099-dcf84affc11d could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:06:13.993850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5f0f0bf9-45cc-4e93-b7ca-2cc875cbf587 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d" status: 404 len: 111 microversion: 2.1 time: 0.034990 Nov 02 13:06:13.994430 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 551/1127] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:13 2022] GET /compute/v2.1/servers/ed3a70f5-7a54-4a66-b099-dcf84affc11d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:14.673290 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:14.673857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:14.680628 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:14.681083 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:14.681855 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:14.682283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:14.696427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] HTTP exception thrown: Instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 could not be found. Nov 02 13:06:14.697035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Returning 404 to user: Instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:06:14.697864 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d7533de7-13bf-448c-801c-6fffc45f2292 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "DELETE /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 404 len: 111 microversion: 2.1 time: 0.028595 Nov 02 13:06:14.698408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 577/1128] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:14 2022] DELETE /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:14.708011 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:14.708798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] [instance: 88552fef-2b2e-4ddf-bde5-ef27eeb43214] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:14.716177 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:14.716651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:14.717439 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:14.717867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:14.731900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] HTTP exception thrown: Instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 could not be found. Nov 02 13:06:14.732557 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Returning 404 to user: Instance 88552fef-2b2e-4ddf-bde5-ef27eeb43214 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:06:14.733393 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-68134d54-f2ef-4e97-a844-4776296659b5 tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214" status: 404 len: 111 microversion: 2.1 time: 0.030068 Nov 02 13:06:14.733925 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 552/1129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:14 2022] GET /compute/v2.1/servers/88552fef-2b2e-4ddf-bde5-ef27eeb43214 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:16.061649 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f09c3c45-57b9-4e2c-87c0-48005ff6422a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] Calling method '.version_select at 0x7fbe41ea28b0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:16.082324 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f09c3c45-57b9-4e2c-87c0-48005ff6422a tempest-TestVolumeBootPattern-1413823949 tempest-TestVolumeBootPattern-1413823949-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2037140484" status: 202 len: 0 microversion: 2.1 time: 0.024704 Nov 02 13:06:16.082923 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 578/1130] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Nov 2 13:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2037140484 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:06:26.396989 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-707609273", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:26.460147 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] validate_networks() for None {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:06:26.756344 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:06:26.756769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:06:26.757241 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:06:26.757654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:06:26.758067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:06:26.769090 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:26.769322 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:26.770084 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:26.770538 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:26.788242 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Getting quotas for project 6d23456b3c7840b2a0dc28a2ff6e5dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:06:26.792657 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Getting quotas for user 947854e0aa8a4217a2165a039b940a9c and project 6d23456b3c7840b2a0dc28a2ff6e5dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:06:26.804555 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:06:26.806950 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:06:26.856513 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c82441c3-870b-478b-8da0-f4cf8c711be0 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.463442 Nov 02 13:06:26.857457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 553/1131] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:06:26.869455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-22b161a3-94a0-424b-96fc-ae53886d88ca tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:26.870072 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-22b161a3-94a0-424b-96fc-ae53886d88ca tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:26.926464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-22b161a3-94a0-424b-96fc-ae53886d88ca tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:26.933956 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-22b161a3-94a0-424b-96fc-ae53886d88ca tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1214 microversion: 2.1 time: 0.069231 Nov 02 13:06:26.935009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 579/1132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:26 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:27.964039 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:27.964875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:27.972275 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:27.972674 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:27.973481 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:27.973920 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:28.074760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:28.083449 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f588369d-9c45-4a58-ad06-ee03eed822dd tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1274 microversion: 2.1 time: 0.126854 Nov 02 13:06:28.084374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 554/1133] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:27 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:29.108751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:29.110665 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:29.119415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:29.119974 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:29.121298 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:29.122216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:29.281671 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:29.290066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-165cedd6-86fd-4f23-a6b3-8d9a81f4ad4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.185418 Nov 02 13:06:29.291128 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 580/1134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:29 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:29.568879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d7ffef5f-03e1-4395-8bdf-a82d49e58188 req-756195b0-bf8e-4855-a4e0-80f3a6759dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aca96bc-cd6b-481f-8345-50a82e314959", "tag": "b2d14577-5b0b-4e01-b789-18f17b16b944"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:29.579342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d7ffef5f-03e1-4395-8bdf-a82d49e58188 req-756195b0-bf8e-4855-a4e0-80f3a6759dd7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:29.579814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d7ffef5f-03e1-4395-8bdf-a82d49e58188 req-756195b0-bf8e-4855-a4e0-80f3a6759dd7 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:29.592070 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d7ffef5f-03e1-4395-8bdf-a82d49e58188 req-756195b0-bf8e-4855-a4e0-80f3a6759dd7 service nova] Creating event network-changed:b2d14577-5b0b-4e01-b789-18f17b16b944 for instance 1aca96bc-cd6b-481f-8345-50a82e314959 on hv-cinder-86327 Nov 02 13:06:29.599570 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d7ffef5f-03e1-4395-8bdf-a82d49e58188 req-756195b0-bf8e-4855-a4e0-80f3a6759dd7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034421 Nov 02 13:06:29.600515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 555/1135] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:30.315555 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:30.316177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:30.323491 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:30.323978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:30.324985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:30.325411 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:30.474277 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:30.482541 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4b37458c-8514-4d3d-8a26-85d212023713 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.170985 Nov 02 13:06:30.483129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 581/1136] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:30 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:31.509723 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:31.510741 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:31.518032 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:31.518456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:31.519255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:31.519695 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:31.675208 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:31.685592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9d374075-7117-4cd7-a20d-7d56440fac26 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.182376 Nov 02 13:06:31.686374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 556/1137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:31 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:32.709677 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:32.710267 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:32.717577 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:32.718023 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:32.718804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:32.719229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:32.874161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:32.882177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-885aedcc-36d9-4be0-acfc-adeb9baf02c1 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.176472 Nov 02 13:06:32.882744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 582/1138] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:32 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:33.911041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:33.911688 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:33.918755 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:33.919250 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:33.920038 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:33.920512 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:34.084269 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:34.095724 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ce1694fc-9082-4bdb-a163-8e99ebe89899 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.189230 Nov 02 13:06:34.096547 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 557/1139] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:33 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:35.127981 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:35.128633 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:35.136727 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:35.137225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:35.138072 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:35.138542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:35.287519 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:35.296062 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4ef250ad-fc1e-489d-bc07-68427d2c234c tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.172221 Nov 02 13:06:35.296685 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 583/1140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:35 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:35.787050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d6a7f011-fb33-48c7-a4cc-db8e4881c062 req-03c444bc-ac7c-401e-b093-2096f61eb3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aca96bc-cd6b-481f-8345-50a82e314959", "name": "network-vif-plugged", "status": "completed", "tag": "b2d14577-5b0b-4e01-b789-18f17b16b944"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:35.797062 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d6a7f011-fb33-48c7-a4cc-db8e4881c062 req-03c444bc-ac7c-401e-b093-2096f61eb3fa service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:35.797586 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d6a7f011-fb33-48c7-a4cc-db8e4881c062 req-03c444bc-ac7c-401e-b093-2096f61eb3fa service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:35.810897 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d6a7f011-fb33-48c7-a4cc-db8e4881c062 req-03c444bc-ac7c-401e-b093-2096f61eb3fa service nova] Creating event network-vif-plugged:b2d14577-5b0b-4e01-b789-18f17b16b944 for instance 1aca96bc-cd6b-481f-8345-50a82e314959 on hv-cinder-86327 Nov 02 13:06:35.816330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d6a7f011-fb33-48c7-a4cc-db8e4881c062 req-03c444bc-ac7c-401e-b093-2096f61eb3fa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033090 Nov 02 13:06:35.817136 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 558/1141] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:36.320346 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:36.321092 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:36.327985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:36.328516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:36.329399 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:36.329841 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:36.473211 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:36.481770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-81142823-eed9-494d-bed4-be434abb968a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.166241 Nov 02 13:06:36.482380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 584/1142] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:36 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:37.505222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:37.505977 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:37.513701 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:37.514163 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:37.514948 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:37.515373 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:37.666413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:37.679298 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dc00511a-84ba-4e00-bb50-c3fca4e4be4a tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1314 microversion: 2.1 time: 0.177935 Nov 02 13:06:37.680016 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 559/1143] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:37 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:38.703435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:38.704032 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:38.711060 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:38.711509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:38.712312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:38.712745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:38.869138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:38.877771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e6bd6663-8462-41af-bc85-8fefc4afa5ae tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1463 microversion: 2.1 time: 0.178537 Nov 02 13:06:38.878371 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 585/1144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:38 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1463 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:38.922815 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:38.923388 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:38.930213 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:38.930654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:38.931409 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:38.931837 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:38.956484 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:06:39.037900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d2c9b08e-6928-46d0-8e3a-097a0430a764 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 204 len: 0 microversion: 2.1 time: 0.118534 Nov 02 13:06:39.038676 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 560/1145] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:38 2022] DELETE /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:06:39.047378 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:39.047989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:39.054242 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:39.054695 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:39.055472 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:39.055908 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:39.205567 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:39.213789 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aea96321-e1c7-4bff-bd8b-9bd74044479b tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1469 microversion: 2.1 time: 0.170429 Nov 02 13:06:39.214609 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 586/1146] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:39 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:40.244049 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:40.244823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:40.251587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:40.252068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:40.252911 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:40.253341 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:40.416528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:40.426922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-73a813ed-2733-42cd-8a02-3e1c4150a12f tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1469 microversion: 2.1 time: 0.190334 Nov 02 13:06:40.427548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 561/1147] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:40 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:41.460401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:41.460997 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:41.467766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:41.468247 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:41.469027 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:41.469458 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:41.625853 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947854e0aa8a4217a2165a039b940a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d23456b3c7840b2a0dc28a2ff6e5dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:41.634446 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-57bf85e7-584d-4181-b70d-fb81879ab563 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 200 len: 1469 microversion: 2.1 time: 0.178005 Nov 02 13:06:41.640166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 587/1148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:41 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:41.652783 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-8a4bd9e4-1268-4db5-8eb1-030cf815511c req-91016e6f-9e38-4a87-8e7f-be66b34a0e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aca96bc-cd6b-481f-8345-50a82e314959", "name": "network-vif-deleted", "tag": "b2d14577-5b0b-4e01-b789-18f17b16b944"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:41.662940 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8a4bd9e4-1268-4db5-8eb1-030cf815511c req-91016e6f-9e38-4a87-8e7f-be66b34a0e33 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:41.663911 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8a4bd9e4-1268-4db5-8eb1-030cf815511c req-91016e6f-9e38-4a87-8e7f-be66b34a0e33 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:41.678516 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-8a4bd9e4-1268-4db5-8eb1-030cf815511c req-91016e6f-9e38-4a87-8e7f-be66b34a0e33 service nova] Creating event network-vif-deleted:b2d14577-5b0b-4e01-b789-18f17b16b944 for instance 1aca96bc-cd6b-481f-8345-50a82e314959 on hv-cinder-86327 Nov 02 13:06:41.683678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-8a4bd9e4-1268-4db5-8eb1-030cf815511c req-91016e6f-9e38-4a87-8e7f-be66b34a0e33 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047492 Nov 02 13:06:41.684419 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 562/1149] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:42.658945 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:42.659559 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] [instance: 1aca96bc-cd6b-481f-8345-50a82e314959] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:42.666301 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:42.666811 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:42.667618 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:42.668051 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:42.681713 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] HTTP exception thrown: Instance 1aca96bc-cd6b-481f-8345-50a82e314959 could not be found. Nov 02 13:06:42.682366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] Returning 404 to user: Instance 1aca96bc-cd6b-481f-8345-50a82e314959 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:06:42.683303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ed207aa3-9795-42af-98e7-5186303a5c09 tempest-VolumesNegativeTest-608109898 tempest-VolumesNegativeTest-608109898-project] 10.222.0.90 "GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959" status: 404 len: 111 microversion: 2.1 time: 0.028354 Nov 02 13:06:42.683760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 588/1150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:42 2022] GET /compute/v2.1/servers/1aca96bc-cd6b-481f-8345-50a82e314959 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:43.039410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5223a87b-3fd3-4641-a47d-48f22524f3b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:43.039969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5223a87b-3fd3-4641-a47d-48f22524f3b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:43.046807 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5223a87b-3fd3-4641-a47d-48f22524f3b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:43.047537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5223a87b-3fd3-4641-a47d-48f22524f3b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:43.048369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5223a87b-3fd3-4641-a47d-48f22524f3b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:43.048838 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5223a87b-3fd3-4641-a47d-48f22524f3b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:43.072902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5223a87b-3fd3-4641-a47d-48f22524f3b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/ips" status: 200 len: 150 microversion: 2.1 time: 0.038342 Nov 02 13:06:43.073498 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 563/1151] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 13:06:43 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:45.511864 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fb50f3a3-7261-4deb-b91f-5cc445da0d99 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8010a07-eaae-4cef-b833-6086e142a3fa"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:45.513049 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fb50f3a3-7261-4deb-b91f-5cc445da0d99 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:45.520636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb50f3a3-7261-4deb-b91f-5cc445da0d99 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:45.520636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb50f3a3-7261-4deb-b91f-5cc445da0d99 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:45.521394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb50f3a3-7261-4deb-b91f-5cc445da0d99 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:45.521827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb50f3a3-7261-4deb-b91f-5cc445da0d99 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:45.796604 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fb50f3a3-7261-4deb-b91f-5cc445da0d99 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289016 Nov 02 13:06:45.797264 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 589/1152] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:06:45 2022] POST /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:46.265905 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1735638137"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:46.266456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:46.273278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:46.273734 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:46.274507 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:46.274931 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:46.435535 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.network.security_group_api [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Removing security group 1f7b976e-99c5-4f4a-82b1-a6f3a59b642d from port c9696789-eadb-4104-9a82-9ae275fb1c40 Nov 02 13:06:46.763058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3af9aa86-1dd4-41e8-9cc6-9c40202bbaca tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/action" status: 202 len: 0 microversion: 2.1 time: 0.501137 Nov 02 13:06:46.764350 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 564/1153] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 13:06:46 2022] POST /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:06:46.773311 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-64ed4e55-b615-4ee0-8409-926a86ba0424 req-9f4b4568-64f5-4780-ac9f-7fb1d8c823f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895", "tag": "c9696789-eadb-4104-9a82-9ae275fb1c40"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:46.782461 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-64ed4e55-b615-4ee0-8409-926a86ba0424 req-9f4b4568-64f5-4780-ac9f-7fb1d8c823f3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:46.782808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-64ed4e55-b615-4ee0-8409-926a86ba0424 req-9f4b4568-64f5-4780-ac9f-7fb1d8c823f3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:46.795358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-64ed4e55-b615-4ee0-8409-926a86ba0424 req-9f4b4568-64f5-4780-ac9f-7fb1d8c823f3 service nova] Creating event network-changed:c9696789-eadb-4104-9a82-9ae275fb1c40 for instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 on hv-cinder-86327 Nov 02 13:06:46.800330 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-64ed4e55-b615-4ee0-8409-926a86ba0424 req-9f4b4568-64f5-4780-ac9f-7fb1d8c823f3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031516 Nov 02 13:06:46.801414 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 590/1154] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:48.236512 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:48.237179 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:48.244102 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:48.244648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:48.245515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:48.246179 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:48.350644 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lazy-loading 'services' on Instance uuid 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:06:48.450736 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0ba23c30-6a9b-41b5-aa45-a9856cfa2b2c tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments/aa242b8f-2188-4e4a-a7e1-a7c713abb4f0" status: 202 len: 0 microversion: 2.1 time: 0.218002 Nov 02 13:06:48.452243 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 565/1155] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:06:48 2022] DELETE /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments/aa242b8f-2188-4e4a-a7e1-a7c713abb4f0 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:06:48.462313 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-48919682-8779-4bc6-98bc-84ca12501710 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:48.465156 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-48919682-8779-4bc6-98bc-84ca12501710 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:48.475765 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48919682-8779-4bc6-98bc-84ca12501710 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:48.476394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48919682-8779-4bc6-98bc-84ca12501710 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:48.477276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48919682-8779-4bc6-98bc-84ca12501710 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:48.477856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-48919682-8779-4bc6-98bc-84ca12501710 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:48.513745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-48919682-8779-4bc6-98bc-84ca12501710 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057392 Nov 02 13:06:48.514327 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 591/1156] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:06:48 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:48.820271 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-e68c1205-9346-4df5-b2ff-7306b89d7d19 req-9dd4d327-b4a1-4a20-b961-48a7afab7ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895", "tag": "c9696789-eadb-4104-9a82-9ae275fb1c40"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:48.830636 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e68c1205-9346-4df5-b2ff-7306b89d7d19 req-9dd4d327-b4a1-4a20-b961-48a7afab7ebb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:48.831183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e68c1205-9346-4df5-b2ff-7306b89d7d19 req-9dd4d327-b4a1-4a20-b961-48a7afab7ebb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:48.844816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-e68c1205-9346-4df5-b2ff-7306b89d7d19 req-9dd4d327-b4a1-4a20-b961-48a7afab7ebb service nova] Creating event network-changed:c9696789-eadb-4104-9a82-9ae275fb1c40 for instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 on hv-cinder-86327 Nov 02 13:06:48.850109 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-e68c1205-9346-4df5-b2ff-7306b89d7d19 req-9dd4d327-b4a1-4a20-b961-48a7afab7ebb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034739 Nov 02 13:06:48.850792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 566/1157] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:49.529522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a161713f-3242-4722-8595-73cfcc24caee tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:49.533632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a161713f-3242-4722-8595-73cfcc24caee tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:49.546225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a161713f-3242-4722-8595-73cfcc24caee tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:49.548140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a161713f-3242-4722-8595-73cfcc24caee tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:49.549164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a161713f-3242-4722-8595-73cfcc24caee tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:49.550026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a161713f-3242-4722-8595-73cfcc24caee tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:49.589875 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a161713f-3242-4722-8595-73cfcc24caee tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067555 Nov 02 13:06:49.599195 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 592/1158] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:06:49 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:50.605533 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c73e7e0d-ef01-473b-889a-486e204ef73a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:50.607123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c73e7e0d-ef01-473b-889a-486e204ef73a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:50.613900 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c73e7e0d-ef01-473b-889a-486e204ef73a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:50.614717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c73e7e0d-ef01-473b-889a-486e204ef73a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:50.615744 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c73e7e0d-ef01-473b-889a-486e204ef73a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:50.616432 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c73e7e0d-ef01-473b-889a-486e204ef73a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:50.697964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c73e7e0d-ef01-473b-889a-486e204ef73a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097437 Nov 02 13:06:50.698605 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 567/1159] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:06:50 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:51.710924 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-32bc15f0-dbb5-4696-aac6-616d3d56c76d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:51.712081 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-32bc15f0-dbb5-4696-aac6-616d3d56c76d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:51.719623 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32bc15f0-dbb5-4696-aac6-616d3d56c76d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:51.720164 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32bc15f0-dbb5-4696-aac6-616d3d56c76d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:51.721086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32bc15f0-dbb5-4696-aac6-616d3d56c76d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:51.721528 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32bc15f0-dbb5-4696-aac6-616d3d56c76d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:51.752561 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-32bc15f0-dbb5-4696-aac6-616d3d56c76d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Nov 02 13:06:51.753804 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 593/1160] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:06:51 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:52.767203 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-87de3901-6087-4a92-a0be-9d14b1d83fbf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:52.770376 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-87de3901-6087-4a92-a0be-9d14b1d83fbf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:52.780947 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87de3901-6087-4a92-a0be-9d14b1d83fbf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:52.781428 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87de3901-6087-4a92-a0be-9d14b1d83fbf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:52.783160 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87de3901-6087-4a92-a0be-9d14b1d83fbf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:52.783682 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87de3901-6087-4a92-a0be-9d14b1d83fbf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:52.823838 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-87de3901-6087-4a92-a0be-9d14b1d83fbf tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061782 Nov 02 13:06:52.830616 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 568/1161] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:06:52 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:53.450914 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2c7ca46-291e-49a1-aa7c-ed3484af8a7c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: .version_select at 0x7fbe41fe3160>, body: {"keypair": {"name": "tempest-keypair-2126957551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmylI3IsW8I4gLMf/O9gttD0erVVq5Io1UvUa82ZR1au01OAM876OVXFOdj4Sm/l7kmRMYzgvJ/Zmlru/+/4VgZK6AWU5vPqSluPIfD9L+THVfw2AaI/5ZypXfJ6RtvrA=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:53.470003 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-f2c7ca46-291e-49a1-aa7c-ed3484af8a7c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:06:53.474910 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-f2c7ca46-291e-49a1-aa7c-ed3484af8a7c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:06:53.507687 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f2c7ca46-291e-49a1-aa7c-ed3484af8a7c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062218 Nov 02 13:06:53.509489 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 594/1162] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 13:06:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:53.842603 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-867ae77e-bd88-436e-bd4b-89145fb5a39a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:53.844703 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-867ae77e-bd88-436e-bd4b-89145fb5a39a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:53.852980 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-867ae77e-bd88-436e-bd4b-89145fb5a39a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:53.853538 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-867ae77e-bd88-436e-bd4b-89145fb5a39a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:53.854874 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-867ae77e-bd88-436e-bd4b-89145fb5a39a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:53.855529 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-867ae77e-bd88-436e-bd4b-89145fb5a39a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:53.900255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-867ae77e-bd88-436e-bd4b-89145fb5a39a tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065282 Nov 02 13:06:53.901164 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 569/1163] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:06:53 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:06:53.912972 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:53.913459 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:53.920723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:53.921481 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:53.922465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:53.923167 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:54.012717 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] HTTP exception thrown: Instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 is not attached to volume aa242b8f-2188-4e4a-a7e1-a7c713abb4f0 Nov 02 13:06:54.013678 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Returning 404 to user: Instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 is not attached to volume aa242b8f-2188-4e4a-a7e1-a7c713abb4f0 {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:06:54.014699 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ab930c5e-7797-4ab1-853d-c320aeedb92d tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments/aa242b8f-2188-4e4a-a7e1-a7c713abb4f0" status: 404 len: 154 microversion: 2.1 time: 0.106150 Nov 02 13:06:54.015792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 595/1164] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:06:53 2022] DELETE /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895/os-volume_attachments/aa242b8f-2188-4e4a-a7e1-a7c713abb4f0 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:55.237093 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:55.237816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:55.248072 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:55.248546 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:55.249360 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:55.249798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:55.296316 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:06:55.431747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-152b8264-fe94-49eb-a54c-0cdf6c5c1d4e tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 204 len: 0 microversion: 2.1 time: 0.198072 Nov 02 13:06:55.434005 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 570/1165] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:06:55 2022] DELETE /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:06:55.442251 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:55.443074 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:55.450946 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:55.451299 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:55.452095 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:55.452567 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:55.787225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:55.798853 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f577b9be-fc0d-4b9b-9ebf-c97700bf42ea tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1553 microversion: 2.1 time: 0.360317 Nov 02 13:06:55.809289 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 596/1166] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:55 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1553 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:55.826145 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1595006972", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46222446-e421-4f44-b970-f0c2d05a9631"}], "security_groups": [{"name": "tempest-securitygroup--1721193339"}], "key_name": "tempest-keypair-2126957551", "user_data": "}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:56.003592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] validate_networks() for [('46222446-e421-4f44-b970-f0c2d05a9631', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:06:56.826366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:56.826993 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:56.840854 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:56.841454 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:56.842350 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:56.842979 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:56.924318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:06:56.924985 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:06:56.926125 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:06:56.926621 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:06:56.927665 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:06:56.942798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:56.943713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:56.944741 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:56.945589 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:56.977113 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:06:56.982058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:06:57.008046 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:06:57.015754 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:06:57.118932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ae8c4a99-8760-45f8-a31f-b36e0de5c132 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.293947 Nov 02 13:06:57.120798 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 571/1167] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:06:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:06:57.137362 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-386cc966-4ffd-44bf-b6ad-835c0452cab7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:57.137875 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:57.139514 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-386cc966-4ffd-44bf-b6ad-835c0452cab7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:57.154725 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4edeb236-b6b5-4cde-a940-ba1dc4c3c609 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1553 microversion: 2.1 time: 0.332803 Nov 02 13:06:57.156495 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 597/1168] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:56 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1553 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:57.231592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-386cc966-4ffd-44bf-b6ad-835c0452cab7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:57.242780 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-386cc966-4ffd-44bf-b6ad-835c0452cab7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1242 microversion: 2.1 time: 0.113025 Nov 02 13:06:57.243727 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 572/1169] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:57 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:58.179827 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:58.180537 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:58.196107 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:58.198948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:58.201398 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:58.213366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:58.272070 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:58.274323 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:58.301919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:58.302387 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:58.303206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:58.311003 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:58.475758 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:58.485554 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eed34990-3fa2-485c-bd98-0635859914a8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1553 microversion: 2.1 time: 0.309857 Nov 02 13:06:58.500502 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:58.502276 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 598/1170] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:58 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:58.511269 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-33cb6550-214f-43e0-a3ad-8af4a834534b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1294 microversion: 2.1 time: 0.248604 Nov 02 13:06:58.512349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 573/1171] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:58 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1294 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:59.113675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-fd94cdcb-8b4e-4bf4-ac0b-45c74cea2173 req-d837d6a6-0e8c-4c52-835f-15bda8d43bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895", "name": "network-vif-deleted", "tag": "c9696789-eadb-4104-9a82-9ae275fb1c40"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:59.131720 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-fd94cdcb-8b4e-4bf4-ac0b-45c74cea2173 req-d837d6a6-0e8c-4c52-835f-15bda8d43bf3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:59.132500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-fd94cdcb-8b4e-4bf4-ac0b-45c74cea2173 req-d837d6a6-0e8c-4c52-835f-15bda8d43bf3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:59.162680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-fd94cdcb-8b4e-4bf4-ac0b-45c74cea2173 req-d837d6a6-0e8c-4c52-835f-15bda8d43bf3 service nova] Creating event network-vif-deleted:c9696789-eadb-4104-9a82-9ae275fb1c40 for instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 on hv-cinder-86327 Nov 02 13:06:59.170902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-fd94cdcb-8b4e-4bf4-ac0b-45c74cea2173 req-d837d6a6-0e8c-4c52-835f-15bda8d43bf3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063838 Nov 02 13:06:59.172968 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 574/1172] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:59.340041 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9b101c83-82b1-4da4-ad43-38e89224f36d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Action: 'create', calling method: .version_select at 0x7fbe41ffcf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-334502367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGeyERWZpHFed5TqcDxy1BUyZow5dd6Iq+IDlyqV1oH0O4oyVFPJCbkPfjw60SACKpP9XIsIyabBSDb6HHGAkg0DXKT6wvUPkvNQseBKSadTwqGwiSEW2txlec5CUJSug=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:59.359363 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-9b101c83-82b1-4da4-ad43-38e89224f36d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Getting quotas for project 22ac1778be064017858e588e9567fd27. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:06:59.375304 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-9b101c83-82b1-4da4-ad43-38e89224f36d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Getting quotas for user 39f0c145873843fa9cb970bba426cbdf and project 22ac1778be064017858e588e9567fd27. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:06:59.422345 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9b101c83-82b1-4da4-ad43-38e89224f36d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.369522 Nov 02 13:06:59.423011 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 599/1173] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 13:06:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:59.513856 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:59.515307 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:59.549398 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:59.551687 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:06:59.562067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:59.562597 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:59.563413 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:59.563890 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:59.564453 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:59.565298 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:59.566500 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:59.567535 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:59.646581 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:06:59.647032 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:06:59.647491 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lazy-loading 'fault' on Instance uuid 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:06:59.697291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:59.705806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bed71c6f-a265-4cec-a9cc-558161e8fd12 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1300 microversion: 2.1 time: 0.172125 Nov 02 13:06:59.709645 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 600/1174] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:59 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:59.725208 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c52946945e41e8910c7179b03af2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5716ca4d4fc14873bdb6a99cecc9ed64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:06:59.767140 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-402188f0-a47b-4be0-a874-543c6d6bad71 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 200 len: 1347 microversion: 2.1 time: 0.257658 Nov 02 13:06:59.768468 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 575/1175] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:06:59 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 1347 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:00.735739 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:00.736484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:00.768726 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:00.769646 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:00.770725 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:00.771443 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:00.794928 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:00.796501 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] [instance: 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:00.821048 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:00.824881 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:00.825855 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:00.826312 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:00.881865 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] HTTP exception thrown: Instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 could not be found. Nov 02 13:07:00.882582 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Returning 404 to user: Instance 9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:07:00.883832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-670e9972-f29d-4ed5-9c9a-d085b727fe7f tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895" status: 404 len: 111 microversion: 2.1 time: 0.093097 Nov 02 13:07:00.887643 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 576/1176] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:00 2022] GET /compute/v2.1/servers/9e2d3f4f-56a9-428e-a7e1-29b9a5a9d895 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:07:00.899188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e08530e-0371-4c8d-a481-1b5c493dfdf8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] Calling method '.version_select at 0x7fbe427fc430>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:00.940678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e08530e-0371-4c8d-a481-1b5c493dfdf8 tempest-TestMinimumBasicScenario-626358580 tempest-TestMinimumBasicScenario-626358580-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-90965896" status: 202 len: 0 microversion: 2.1 time: 0.051527 Nov 02 13:07:00.941713 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 577/1177] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Nov 2 13:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-90965896 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:07:01.060415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:01.071711 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9ce6cd4a-4605-46f6-9274-612d80cdd1ed tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1368 microversion: 2.1 time: 0.339866 Nov 02 13:07:01.087415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 601/1178] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:00 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:01.552641 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-4226699e-877a-4e75-a31a-848da9c0978e req-b5fd5a93-766c-4c43-9d3d-9dab9cb8efc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0c3e26-4375-4db6-b45b-813178cbdacd", "tag": "9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:01.566878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-4226699e-877a-4e75-a31a-848da9c0978e req-b5fd5a93-766c-4c43-9d3d-9dab9cb8efc1 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:01.567425 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-4226699e-877a-4e75-a31a-848da9c0978e req-b5fd5a93-766c-4c43-9d3d-9dab9cb8efc1 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:01.578971 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-4226699e-877a-4e75-a31a-848da9c0978e req-b5fd5a93-766c-4c43-9d3d-9dab9cb8efc1 service nova] Creating event network-changed:9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5 for instance 2c0c3e26-4375-4db6-b45b-813178cbdacd on hv-cinder-86327 Nov 02 13:07:01.584237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-4226699e-877a-4e75-a31a-848da9c0978e req-b5fd5a93-766c-4c43-9d3d-9dab9cb8efc1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038376 Nov 02 13:07:01.585277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 578/1179] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:02.097993 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:02.099426 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:02.110978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:02.111533 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:02.112405 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:02.112846 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:02.413466 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:02.427484 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c5118321-ac5b-4b65-980b-b46072a30e00 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1368 microversion: 2.1 time: 0.334737 Nov 02 13:07:02.439241 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 602/1180] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:02 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1368 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:03.456513 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:03.458190 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:03.467427 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:03.467909 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:03.468714 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:03.469154 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:03.799848 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:03.811067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-02aac766-c1b4-4d2c-97dd-c2d95cd7e0d9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1368 microversion: 2.1 time: 0.360060 Nov 02 13:07:03.812412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 579/1181] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:03 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:04.845382 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:04.848326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:04.856698 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:04.857145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:04.857928 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:04.858359 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:05.013167 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:05.021822 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4c036f9e-8a08-4413-ae44-68d68aaa2720 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1368 microversion: 2.1 time: 0.183239 Nov 02 13:07:05.023166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 603/1182] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:04 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:06.047934 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:06.048580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:06.055517 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:06.056058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:06.056870 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:06.057398 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:06.204468 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:06.212655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-43a34fa9-d06c-4573-8b53-bfe711e5528c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1368 microversion: 2.1 time: 0.168722 Nov 02 13:07:06.213248 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 580/1183] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:06 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:07.239456 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:07.240010 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:07.246882 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:07.247478 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:07.248293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:07.248776 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:07.506624 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:07.516706 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c7a28b6e-2a05-4b39-bde9-01b904aeea23 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1368 microversion: 2.1 time: 0.282358 Nov 02 13:07:07.517564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 604/1184] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:07 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:07.957041 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-5eb28f63-4b9a-435a-8698-4b5eef589edf req-5baa38e2-10fe-482b-b570-8d576ead26cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0c3e26-4375-4db6-b45b-813178cbdacd", "name": "network-vif-plugged", "status": "completed", "tag": "9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:07.978578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5eb28f63-4b9a-435a-8698-4b5eef589edf req-5baa38e2-10fe-482b-b570-8d576ead26cf service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:07.979329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5eb28f63-4b9a-435a-8698-4b5eef589edf req-5baa38e2-10fe-482b-b570-8d576ead26cf service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:07.996710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-5eb28f63-4b9a-435a-8698-4b5eef589edf req-5baa38e2-10fe-482b-b570-8d576ead26cf service nova] Creating event network-vif-plugged:9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5 for instance 2c0c3e26-4375-4db6-b45b-813178cbdacd on hv-cinder-86327 Nov 02 13:07:08.003957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-5eb28f63-4b9a-435a-8698-4b5eef589edf req-5baa38e2-10fe-482b-b570-8d576ead26cf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051438 Nov 02 13:07:08.004965 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 581/1185] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:08.543657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:08.545127 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:08.560469 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:08.561328 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:08.562354 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:08.562794 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:09.060581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:09.068802 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9bf7d455-4d95-4d6b-9399-7b367dfe138d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1368 microversion: 2.1 time: 0.529636 Nov 02 13:07:09.080794 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 605/1186] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:08 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1368 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:10.094671 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:10.095511 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:10.101934 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:10.102853 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:10.103652 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:10.104281 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:10.259752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:10.268850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-48300158-ddf8-47bf-8a6a-d6f623f31311 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1559 microversion: 2.1 time: 0.179150 Nov 02 13:07:10.269587 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 582/1187] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:10 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:10.294219 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bf4f009e-4dd9-4bb7-ba02-446f86f08186 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:10.294769 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bf4f009e-4dd9-4bb7-ba02-446f86f08186 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:10.301654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf4f009e-4dd9-4bb7-ba02-446f86f08186 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:10.302132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf4f009e-4dd9-4bb7-ba02-446f86f08186 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:10.302906 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf4f009e-4dd9-4bb7-ba02-446f86f08186 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:10.303338 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf4f009e-4dd9-4bb7-ba02-446f86f08186 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:10.402875 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bf4f009e-4dd9-4bb7-ba02-446f86f08186 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113143 Nov 02 13:07:10.403676 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 606/1188] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 13:07:10 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:11.606939 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-39ab3609-14f0-49a2-9408-fce62653c670 req-9f227417-a2a9-4b73-a7ff-12212b67fee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0c3e26-4375-4db6-b45b-813178cbdacd", "tag": "9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:11.615842 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-39ab3609-14f0-49a2-9408-fce62653c670 req-9f227417-a2a9-4b73-a7ff-12212b67fee1 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:11.616315 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-39ab3609-14f0-49a2-9408-fce62653c670 req-9f227417-a2a9-4b73-a7ff-12212b67fee1 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:11.628906 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-39ab3609-14f0-49a2-9408-fce62653c670 req-9f227417-a2a9-4b73-a7ff-12212b67fee1 service nova] Creating event network-changed:9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5 for instance 2c0c3e26-4375-4db6-b45b-813178cbdacd on hv-cinder-86327 Nov 02 13:07:11.634313 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-39ab3609-14f0-49a2-9408-fce62653c670 req-9f227417-a2a9-4b73-a7ff-12212b67fee1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031216 Nov 02 13:07:11.634964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 583/1189] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:23.746218 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-61523363", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-334502367", "security_groups": [{"name": "tempest-secgroup-smoke-734687273"}], "networks": [{"uuid": "e3bfda93-bf92-4220-aa0c-1248f9d5b459"}], "block_device_mapping_v2": [{"uuid": "f959a587-94d7-42ab-80cb-0241ee937a0e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:23.862914 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] validate_networks() for [('e3bfda93-bf92-4220-aa0c-1248f9d5b459', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:07:24.287560 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:07:24.287978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:07:24.288714 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:07:24.289131 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:07:24.289540 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:07:24.302795 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:24.303326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:24.304186 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:24.304705 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:24.322152 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Getting quotas for project 22ac1778be064017858e588e9567fd27. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:07:24.326496 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Getting quotas for user 39f0c145873843fa9cb970bba426cbdf and project 22ac1778be064017858e588e9567fd27. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:07:24.388517 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:07:24.390764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f959a587-94d7-42ab-80cb-0241ee937a0e',volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:07:24.521504 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [a4fbea9d-937b-432c-9ab4-15e472fd9d5b] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:07:25.531075 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [a4fbea9d-937b-432c-9ab4-15e472fd9d5b] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 37644. Nov 02 13:07:25.535691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c0b6cde5-3ec2-47c7-88d9-06ef99a19c5f tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.793815 Nov 02 13:07:25.536303 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 607/1190] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:07:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:07:25.550075 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5cc27d8d-cd5f-4077-8c3d-b4bf1dd29f24 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:25.552079 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5cc27d8d-cd5f-4077-8c3d-b4bf1dd29f24 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:25.610606 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5cc27d8d-cd5f-4077-8c3d-b4bf1dd29f24 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:25.618527 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5cc27d8d-cd5f-4077-8c3d-b4bf1dd29f24 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1086 microversion: 2.1 time: 0.073177 Nov 02 13:07:25.619119 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 584/1191] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:25 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1086 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:26.643831 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:26.644614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:26.652246 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:26.653127 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:26.653902 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:26.654348 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:26.720355 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:26.728978 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-295056cc-931b-49d1-8cbe-4bbed1a12fcb tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1192 microversion: 2.1 time: 0.090250 Nov 02 13:07:26.730182 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 608/1192] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:26 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:27.753773 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:27.754446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:27.763771 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:27.764225 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:27.765019 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:27.765457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:28.080878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:28.093152 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fb28cc31-21b3-49dd-81c4-2013333ca60e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.343246 Nov 02 13:07:28.094082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 585/1193] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:27 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:28.402312 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-02cfbdde-847c-4314-834e-228851bcb1bf req-4afa18d9-d9b6-46f3-927a-e86afec64f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606f86c3-9fe0-4271-b2b9-28fa23832a71", "tag": "9ff7f99c-5f23-4304-90e6-678baee4ab6a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:28.413948 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-02cfbdde-847c-4314-834e-228851bcb1bf req-4afa18d9-d9b6-46f3-927a-e86afec64f79 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:28.414408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-02cfbdde-847c-4314-834e-228851bcb1bf req-4afa18d9-d9b6-46f3-927a-e86afec64f79 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:28.427699 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-02cfbdde-847c-4314-834e-228851bcb1bf req-4afa18d9-d9b6-46f3-927a-e86afec64f79 service nova] Creating event network-changed:9ff7f99c-5f23-4304-90e6-678baee4ab6a for instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 on hv-cinder-86327 Nov 02 13:07:28.434401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-02cfbdde-847c-4314-834e-228851bcb1bf req-4afa18d9-d9b6-46f3-927a-e86afec64f79 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034956 Nov 02 13:07:28.434401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 609/1194] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:29.126658 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:29.127393 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:29.137182 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:29.137743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:29.138537 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:29.138971 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:29.372864 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:29.381553 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bd84e7d2-c860-471b-b2fc-7e51e432fa04 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.258907 Nov 02 13:07:29.382155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 586/1195] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:29 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:30.406661 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:30.407398 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:30.414252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:30.414731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:30.415523 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:30.415941 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:30.572897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:30.581349 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fde4e5e0-94b6-4170-98fb-957ed68e9a6a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.179553 Nov 02 13:07:30.581911 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 610/1196] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:30 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:31.604598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:31.605385 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:31.612913 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:31.613368 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:31.614146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:31.614769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:31.767399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:31.780672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dad07105-01d2-44ac-a72a-f4bcca5903f0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.177598 Nov 02 13:07:31.780672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 587/1197] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:31 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:32.804066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:32.804817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:32.813811 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:32.814260 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:32.815076 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:32.815511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:32.975803 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:32.985413 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-689e0fb0-4a1a-4c29-a43b-37fffa57722b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.185347 Nov 02 13:07:32.986002 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 611/1198] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:32 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:34.009443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:34.010341 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:34.017553 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:34.018008 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:34.018783 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:34.019218 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:34.158773 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:34.167200 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1b71a3bb-6d24-4d9b-935c-1cb62d24908d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.162133 Nov 02 13:07:34.167800 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 588/1199] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:34 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:35.193306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:35.194666 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:35.201877 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:35.202336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:35.203137 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:35.203572 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:35.363699 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:35.371940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4beda3bb-ffa4-4d24-832c-8a94b8115702 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.184825 Nov 02 13:07:35.372552 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 612/1200] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:35 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:36.398621 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:36.399311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:36.406878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:36.407306 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:36.408278 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:36.408705 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:36.570887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:36.582859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8850be70-f930-41e2-b2e0-be75e4646c9c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.190093 Nov 02 13:07:36.583776 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 589/1201] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:36 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:37.608519 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:37.609307 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:37.617134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:37.617907 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:37.619351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:37.620037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:37.777594 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:37.786494 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-84b2c4d3-e79e-4e02-8877-83cf882176ba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.182430 Nov 02 13:07:37.787117 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 613/1202] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:37 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:38.815511 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:38.816108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:38.823346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:38.823818 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:38.824652 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:38.825090 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:38.984760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:38.993220 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-912d60f5-3497-485f-bbba-2a9c37a03ff0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.181695 Nov 02 13:07:38.993833 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 590/1203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:38 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:40.018145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:40.018857 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:40.026436 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:40.027006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:40.028012 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:40.028495 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:40.061964 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-56a99afe-b618-4a92-90a2-c2448b6ad736 req-c76ebf85-199a-4429-82b1-80db825b12f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606f86c3-9fe0-4271-b2b9-28fa23832a71", "name": "network-vif-plugged", "status": "completed", "tag": "9ff7f99c-5f23-4304-90e6-678baee4ab6a"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:40.076673 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-56a99afe-b618-4a92-90a2-c2448b6ad736 req-c76ebf85-199a-4429-82b1-80db825b12f2 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:40.079859 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-56a99afe-b618-4a92-90a2-c2448b6ad736 req-c76ebf85-199a-4429-82b1-80db825b12f2 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:40.106995 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-56a99afe-b618-4a92-90a2-c2448b6ad736 req-c76ebf85-199a-4429-82b1-80db825b12f2 service nova] Creating event network-vif-plugged:9ff7f99c-5f23-4304-90e6-678baee4ab6a for instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 on hv-cinder-86327 Nov 02 13:07:40.113377 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-56a99afe-b618-4a92-90a2-c2448b6ad736 req-c76ebf85-199a-4429-82b1-80db825b12f2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058246 Nov 02 13:07:40.114162 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 591/1204] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:07:40.226239 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:40.234433 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dbef955d-fce9-4072-b544-663ce32071a4 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.220804 Nov 02 13:07:40.235014 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 614/1205] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:40 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:41.263560 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:41.264360 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:41.271067 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:41.271515 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:41.272335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:41.272816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:41.434267 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:41.442748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d434472a-6a91-41a9-a856-39d41d79dda5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1257 microversion: 2.1 time: 0.184963 Nov 02 13:07:41.443376 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 592/1206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:41 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1257 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:42.467821 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:42.468899 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:42.475752 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:42.476220 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:42.477026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:42.477455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:42.636608 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:42.644837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a6dfb810-79a6-4bc3-8d2f-51f8e9f1a070 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1441 microversion: 2.1 time: 0.181093 Nov 02 13:07:42.645410 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 615/1207] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:42 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1441 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:07:42.668348 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:07:42.669274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:07:42.678481 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:42.679064 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:42.680237 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:42.680979 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:42.876998 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:07:42.886300 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b4e0fb97-bbd5-4a5f-9686-6b2743848aa0 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1441 microversion: 2.1 time: 0.222084 Nov 02 13:07:42.886899 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 593/1208] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:07:42 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1441 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:07:45.133511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-923f9866-b0e4-4760-86fe-0baefba23b36 req-8c083109-07e6-425b-becd-b7dd30ec6b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606f86c3-9fe0-4271-b2b9-28fa23832a71", "tag": "9ff7f99c-5f23-4304-90e6-678baee4ab6a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:45.143806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-923f9866-b0e4-4760-86fe-0baefba23b36 req-8c083109-07e6-425b-becd-b7dd30ec6b49 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:07:45.144300 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-923f9866-b0e4-4760-86fe-0baefba23b36 req-8c083109-07e6-425b-becd-b7dd30ec6b49 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:07:45.155971 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-923f9866-b0e4-4760-86fe-0baefba23b36 req-8c083109-07e6-425b-becd-b7dd30ec6b49 service nova] Creating event network-changed:9ff7f99c-5f23-4304-90e6-678baee4ab6a for instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 on hv-cinder-86327 Nov 02 13:07:45.161543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-923f9866-b0e4-4760-86fe-0baefba23b36 req-8c083109-07e6-425b-becd-b7dd30ec6b49 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032319 Nov 02 13:07:45.162155 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 616/1209] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:39.367678 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-234e2318-d2bc-42ae-a87b-92404e6f03ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:39.368460 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-234e2318-d2bc-42ae-a87b-92404e6f03ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:39.375212 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-234e2318-d2bc-42ae-a87b-92404e6f03ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.375695 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-234e2318-d2bc-42ae-a87b-92404e6f03ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:39.376668 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-234e2318-d2bc-42ae-a87b-92404e6f03ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.377106 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-234e2318-d2bc-42ae-a87b-92404e6f03ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:39.404003 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-234e2318-d2bc-42ae-a87b-92404e6f03ae tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd/ips" status: 200 len: 151 microversion: 2.1 time: 0.040530 Nov 02 13:08:39.410661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 594/1210] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 13:08:39 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:39.422087 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8010a07-eaae-4cef-b833-6086e142a3fa"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:39.423238 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:39.430339 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.430966 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:39.431912 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.432428 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:39.739718 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Invalid volume: volume f8010a07-eaae-4cef-b833-6086e142a3fa is already attached to instances: ca6f26a5-a573-4de6-8bfa-8d10d473bd43 Nov 02 13:08:39.740395 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 400 to user: Invalid volume: volume f8010a07-eaae-4cef-b833-6086e142a3fa is already attached to instances: ca6f26a5-a573-4de6-8bfa-8d10d473bd43 {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:08:39.741291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-769bb6e9-d928-4e7a-a556-73e95fe4b222 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.324901 Nov 02 13:08:39.741826 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 617/1211] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:08:39 2022] POST /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd/os-volume_attachments => generated 174 bytes in 326 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:08:39.750635 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:39.751178 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:39.758186 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.758630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:39.759394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.759827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:39.784023 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:08:39.864222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-35d47134-057a-4491-9478-ed841b0917c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 204 len: 0 microversion: 2.1 time: 0.117244 Nov 02 13:08:39.864835 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 595/1212] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:08:39 2022] DELETE /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:08:39.873799 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:39.874402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:39.881506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.882486 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:39.883254 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:39.883667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:40.025792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:40.037237 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4d4e29b4-9edf-4b56-97eb-2af1c43e7af7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1684 microversion: 2.1 time: 0.167750 Nov 02 13:08:40.037777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 618/1213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:39 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:41.063592 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:41.064454 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:41.070926 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:41.071456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:41.072234 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:41.072692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:41.266169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:41.274168 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ccc4c752-28fc-4c03-98d4-5acbc5faccd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1684 microversion: 2.1 time: 0.214997 Nov 02 13:08:41.274747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 596/1214] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:41 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1684 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:42.299166 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:42.299911 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:42.306682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:42.307122 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:42.307890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:42.308353 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:42.448626 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:42.456279 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-98078f9c-d683-4e11-940b-da26d3f12029 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 200 len: 1684 microversion: 2.1 time: 0.160986 Nov 02 13:08:42.456848 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 619/1215] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:42 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:42.867392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-42e924ad-2ec3-4d2d-8904-72f344c51f61 req-b0d67764-ec20-49e6-a73a-036662708aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0c3e26-4375-4db6-b45b-813178cbdacd", "name": "network-vif-deleted", "tag": "9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:42.877814 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-42e924ad-2ec3-4d2d-8904-72f344c51f61 req-b0d67764-ec20-49e6-a73a-036662708aff service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:42.878372 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-42e924ad-2ec3-4d2d-8904-72f344c51f61 req-b0d67764-ec20-49e6-a73a-036662708aff service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:42.895346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-42e924ad-2ec3-4d2d-8904-72f344c51f61 req-b0d67764-ec20-49e6-a73a-036662708aff service nova] Creating event network-vif-deleted:9be4faf2-3140-4a69-8ac4-6ad9a98fd9f5 for instance 2c0c3e26-4375-4db6-b45b-813178cbdacd on hv-cinder-86327 Nov 02 13:08:42.901082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-42e924ad-2ec3-4d2d-8904-72f344c51f61 req-b0d67764-ec20-49e6-a73a-036662708aff service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103686 Nov 02 13:08:42.902369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 597/1216] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:43.479467 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:43.480293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:43.487132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:43.487614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:43.488518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:43.488954 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:43.506408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance 2c0c3e26-4375-4db6-b45b-813178cbdacd could not be found. Nov 02 13:08:43.507529 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance 2c0c3e26-4375-4db6-b45b-813178cbdacd could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:08:43.508522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3cdd8f40-80e9-4839-bacf-4419bdf6f373 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 404 len: 111 microversion: 2.1 time: 0.033400 Nov 02 13:08:43.509099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 620/1217] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:43 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:08:43.519008 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-16b97781-7d93-4a08-a230-38641dacd5c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '.version_select at 0x7fbe427f9790>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:43.538588 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-16b97781-7d93-4a08-a230-38641dacd5c0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126957551" status: 202 len: 0 microversion: 2.1 time: 0.024223 Nov 02 13:08:43.539180 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 598/1218] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Nov 2 13:08:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126957551 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:08:44.263767 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:44.264317 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:44.270764 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:44.271185 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:44.271958 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:44.272427 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:44.352856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lazy-loading 'services' on Instance uuid ca6f26a5-a573-4de6-8bfa-8d10d473bd43 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:08:44.430113 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c3c28c12-383b-4891-9edf-450f4926c641 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments/f8010a07-eaae-4cef-b833-6086e142a3fa" status: 202 len: 0 microversion: 2.1 time: 0.170185 Nov 02 13:08:44.430738 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 621/1219] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:08:44 2022] DELETE /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments/f8010a07-eaae-4cef-b833-6086e142a3fa => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:08:44.448407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8ba4e413-3f64-46e1-8848-c7aa60ea0aca tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:44.451589 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8ba4e413-3f64-46e1-8848-c7aa60ea0aca tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:44.464563 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ba4e413-3f64-46e1-8848-c7aa60ea0aca tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:44.465209 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ba4e413-3f64-46e1-8848-c7aa60ea0aca tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:44.466173 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ba4e413-3f64-46e1-8848-c7aa60ea0aca tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:44.466763 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8ba4e413-3f64-46e1-8848-c7aa60ea0aca tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:44.510028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8ba4e413-3f64-46e1-8848-c7aa60ea0aca tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071625 Nov 02 13:08:44.510975 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 599/1220] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:08:44 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:45.524690 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-87a5515a-3ce9-4f1a-b2f8-0bb671d41271 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:45.526234 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-87a5515a-3ce9-4f1a-b2f8-0bb671d41271 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:45.532889 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87a5515a-3ce9-4f1a-b2f8-0bb671d41271 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:45.533338 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87a5515a-3ce9-4f1a-b2f8-0bb671d41271 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:45.534170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87a5515a-3ce9-4f1a-b2f8-0bb671d41271 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:45.534607 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-87a5515a-3ce9-4f1a-b2f8-0bb671d41271 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:45.566090 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-87a5515a-3ce9-4f1a-b2f8-0bb671d41271 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046405 Nov 02 13:08:45.566656 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 622/1221] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:08:45 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:08:45.632626 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:45.633209 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:45.640424 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:45.640930 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:45.641755 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:45.642246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:45.675905 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:08:45.763871 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ec1df044-f609-4e03-b4ed-0e7311b2b287 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 204 len: 0 microversion: 2.1 time: 0.134742 Nov 02 13:08:45.765978 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 600/1222] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:08:45 2022] DELETE /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:08:45.774358 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:45.775052 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:45.781652 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:45.782101 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:45.782860 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:45.783293 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:45.932147 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:45.939901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3317d0ba-affe-4b8b-9204-9516799186d2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1682 microversion: 2.1 time: 0.169516 Nov 02 13:08:45.940563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 623/1223] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:45 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:46.966562 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:46.967559 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:46.977878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:46.978622 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:46.979942 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:46.980661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:47.124246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:47.133828 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a3b7aab5-5f4e-4927-af81-63d6c9136c9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1682 microversion: 2.1 time: 0.173821 Nov 02 13:08:47.134408 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 601/1224] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:46 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:48.161317 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:48.161989 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:48.168777 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:48.169257 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:48.170026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:48.170452 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:48.310244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:48.317842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b232f4ce-b91a-4c3a-b857-e471e13bd8c2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1682 microversion: 2.1 time: 0.160887 Nov 02 13:08:48.318445 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 624/1225] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:48 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:48.785076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-3f2ea16f-e7e2-4d57-8862-535670e7084c req-899a1ffb-a5cb-49dd-a0e1-fd3b2de9c871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6f26a5-a573-4de6-8bfa-8d10d473bd43", "name": "network-vif-deleted", "tag": "c70cb391-0da9-4166-9cc2-6633f6288a40"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:48.794845 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-3f2ea16f-e7e2-4d57-8862-535670e7084c req-899a1ffb-a5cb-49dd-a0e1-fd3b2de9c871 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:48.795290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-3f2ea16f-e7e2-4d57-8862-535670e7084c req-899a1ffb-a5cb-49dd-a0e1-fd3b2de9c871 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:48.806885 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-3f2ea16f-e7e2-4d57-8862-535670e7084c req-899a1ffb-a5cb-49dd-a0e1-fd3b2de9c871 service nova] Creating event network-vif-deleted:c70cb391-0da9-4166-9cc2-6633f6288a40 for instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 on hv-cinder-86327 Nov 02 13:08:48.811796 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-3f2ea16f-e7e2-4d57-8862-535670e7084c req-899a1ffb-a5cb-49dd-a0e1-fd3b2de9c871 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030907 Nov 02 13:08:48.812698 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 602/1226] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:49.344022 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:49.345614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:49.354770 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:49.355380 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:49.356181 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:49.356654 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:49.393596 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:49.394048 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:49.394691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lazy-loading 'fault' on Instance uuid ca6f26a5-a573-4de6-8bfa-8d10d473bd43 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:08:49.438856 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:49.446026 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7ebe66a0-4024-47e9-ace6-d1b8a2c52254 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 200 len: 1331 microversion: 2.1 time: 0.106758 Nov 02 13:08:49.446613 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 625/1227] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:49 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:50.473337 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:50.474235 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:50.480879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:50.481327 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:50.482233 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:50.482785 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:50.500131 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 could not be found. Nov 02 13:08:50.500938 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:08:50.502244 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-aec4d473-6ced-49b2-a450-41d816d605b2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 404 len: 111 microversion: 2.1 time: 0.035658 Nov 02 13:08:50.503342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 603/1228] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:50 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:08:50.513401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f5cae3c7-a6db-45a8-83e8-73b3e3c4ccb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '.version_select at 0x7fbe420b3a60>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:50.533402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f5cae3c7-a6db-45a8-83e8-73b3e3c4ccb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027596307" status: 202 len: 0 microversion: 2.1 time: 0.023824 Nov 02 13:08:50.534119 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 626/1229] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Nov 2 13:08:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027596307 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:08:51.435422 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd35f70e-48a4-4ae2-9b7f-b5892d6427de tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: .version_select at 0x7fbe427563a0>, body: {"keypair": {"name": "tempest-keypair-2111172442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZRf+/nCtoOtCKHWP2MlseEHLR2VnLjZXyY8ZVdBFLVlvIWuf4uJZv7U5bRDM/i0hzXS0U3viwHBZMrFYlkqjC7Yb1nE/N/c6dz5CFwO4nHb2SEtquNxXQB5F6pXMJtfA=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:51.450591 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-fd35f70e-48a4-4ae2-9b7f-b5892d6427de tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:08:51.455104 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-fd35f70e-48a4-4ae2-9b7f-b5892d6427de tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:08:51.480833 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd35f70e-48a4-4ae2-9b7f-b5892d6427de tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049307 Nov 02 13:08:51.485330 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 604/1230] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 13:08:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:52.826585 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-998884427", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46222446-e421-4f44-b970-f0c2d05a9631"}], "security_groups": [{"name": "tempest-securitygroup--1946353798"}], "key_name": "tempest-keypair-2111172442", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:52.961625 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] validate_networks() for [('46222446-e421-4f44-b970-f0c2d05a9631', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:08:53.372950 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:08:53.373363 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:08:53.373828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:08:53.374222 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:08:53.374612 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:08:53.384905 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:53.385351 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:53.386154 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:53.386583 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:53.403849 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:08:53.408035 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:08:53.419160 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:08:53.421447 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:08:53.482008 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-582329f7-80c0-4de7-b4cc-e952116a4c20 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660583 Nov 02 13:08:53.482669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 627/1231] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:08:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:08:53.494819 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ded9ed9a-d535-4b9a-b45d-56882d60f41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:53.495477 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ded9ed9a-d535-4b9a-b45d-56882d60f41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:53.551080 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ded9ed9a-d535-4b9a-b45d-56882d60f41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:53.557973 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ded9ed9a-d535-4b9a-b45d-56882d60f41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1241 microversion: 2.1 time: 0.067795 Nov 02 13:08:53.558548 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 605/1232] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:53 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:54.584214 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:54.584214 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:54.590930 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:54.591823 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:54.592632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:54.593225 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:54.674729 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:54.683631 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-97a66d47-2405-4141-bbfa-df2a708f2ffc tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1301 microversion: 2.1 time: 0.105056 Nov 02 13:08:54.684189 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 628/1233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:54 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1301 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:55.716513 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:55.717198 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:55.724136 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:55.724615 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:55.725446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:55.725871 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:55.977160 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:55.984892 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c93c7ec4-9477-481f-8600-3de5d1bd4f2c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.272871 Nov 02 13:08:55.985464 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 606/1234] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:55 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:56.103244 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-ccef03d4-ad64-4289-a6b1-c520f1539a17 req-322c19b3-3937-4223-820a-2f7f3c6ccf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e6e532-d3bb-4834-a859-267ec293ca63", "tag": "2a59fae0-5f91-405f-92d7-106ecf9dd283"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:56.125793 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ccef03d4-ad64-4289-a6b1-c520f1539a17 req-322c19b3-3937-4223-820a-2f7f3c6ccf2b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:56.126386 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ccef03d4-ad64-4289-a6b1-c520f1539a17 req-322c19b3-3937-4223-820a-2f7f3c6ccf2b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:56.139429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-ccef03d4-ad64-4289-a6b1-c520f1539a17 req-322c19b3-3937-4223-820a-2f7f3c6ccf2b service nova] Creating event network-changed:2a59fae0-5f91-405f-92d7-106ecf9dd283 for instance 41e6e532-d3bb-4834-a859-267ec293ca63 on hv-cinder-86327 Nov 02 13:08:56.144929 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-ccef03d4-ad64-4289-a6b1-c520f1539a17 req-322c19b3-3937-4223-820a-2f7f3c6ccf2b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045761 Nov 02 13:08:56.145782 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 629/1235] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:57.008995 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:57.009646 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:57.016932 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:57.017387 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:57.018200 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:57.018992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:57.255132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:57.263489 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-60ec6366-b5dc-4cbf-9496-1a129a783e28 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.258888 Nov 02 13:08:57.264088 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 607/1236] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:57 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:58.292599 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:58.293613 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:58.302742 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:58.303208 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:58.304000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:58.304473 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:58.462092 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:58.470132 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-019d8264-ddd5-4d3e-bb67-9a408f6e6ee3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.185167 Nov 02 13:08:58.470779 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 630/1237] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:58 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:59.495842 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:59.496652 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:08:59.504752 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:59.505509 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:59.506651 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:08:59.507092 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:08:59.650935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:59.658990 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-63e21543-a31d-42e4-b2b1-74aca443ccc1 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.167418 Nov 02 13:08:59.659569 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 608/1238] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:59 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:00.682913 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:00.683547 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:09:00.690562 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:00.691044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:00.691913 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:00.692390 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:00.833169 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:00.841123 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-529d659c-31d5-46d9-92a4-a1ddac3773f0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.162341 Nov 02 13:09:00.841691 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 631/1239] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:00 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:01.865994 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:01.866565 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:09:01.873410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:01.873855 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:01.874617 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:01.875061 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:02.026437 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:02.038936 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f6745ad8-4170-47cd-a1f1-c6009f105154 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.177005 Nov 02 13:09:02.039903 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 609/1240] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:01 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:02.624760 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-c6b44805-21c4-4247-a5e0-2c6b1ae62df0 req-b880b72d-2bcb-4e8d-b279-418d3db2e7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e6e532-d3bb-4834-a859-267ec293ca63", "name": "network-vif-plugged", "status": "completed", "tag": "2a59fae0-5f91-405f-92d7-106ecf9dd283"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:02.633378 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c6b44805-21c4-4247-a5e0-2c6b1ae62df0 req-b880b72d-2bcb-4e8d-b279-418d3db2e7cb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:02.633800 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-c6b44805-21c4-4247-a5e0-2c6b1ae62df0 req-b880b72d-2bcb-4e8d-b279-418d3db2e7cb service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:02.645748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-c6b44805-21c4-4247-a5e0-2c6b1ae62df0 req-b880b72d-2bcb-4e8d-b279-418d3db2e7cb service nova] Creating event network-vif-plugged:2a59fae0-5f91-405f-92d7-106ecf9dd283 for instance 41e6e532-d3bb-4834-a859-267ec293ca63 on hv-cinder-86327 Nov 02 13:09:02.651018 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-c6b44805-21c4-4247-a5e0-2c6b1ae62df0 req-b880b72d-2bcb-4e8d-b279-418d3db2e7cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103292 Nov 02 13:09:02.651615 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 632/1241] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:03.064262 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:03.065068 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:09:03.072137 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:03.072996 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:03.073782 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:03.074260 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:03.233470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:03.241781 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-041267c6-754b-4127-8f2d-972a1a798047 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.182410 Nov 02 13:09:03.242415 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 610/1242] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:03 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:04.272766 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:04.273807 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:09:04.283283 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:04.283839 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:04.284876 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:04.285608 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:04.442115 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:04.450280 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-55f45e7f-d44b-489b-bcbd-5e15126def27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1367 microversion: 2.1 time: 0.184510 Nov 02 13:09:04.450955 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 633/1243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:04 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:05.474349 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:05.474970 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:09:05.481822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:05.482275 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:05.483051 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:05.483489 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:05.630277 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:05.638292 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e03d1b6f-7451-44d7-9e22-20d64bd72313 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1557 microversion: 2.1 time: 0.167957 Nov 02 13:09:05.638867 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 611/1244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:05 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:05.662161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0eea2a8e-3426-45e7-84eb-ecfa714f28b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:05.662752 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0eea2a8e-3426-45e7-84eb-ecfa714f28b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:09:05.669409 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0eea2a8e-3426-45e7-84eb-ecfa714f28b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:05.669853 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0eea2a8e-3426-45e7-84eb-ecfa714f28b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:05.670623 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0eea2a8e-3426-45e7-84eb-ecfa714f28b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:05.671050 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0eea2a8e-3426-45e7-84eb-ecfa714f28b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:05.758278 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0eea2a8e-3426-45e7-84eb-ecfa714f28b0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100121 Nov 02 13:09:05.758926 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 634/1245] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 13:09:05 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:06.693915 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-a09367cc-8576-41ce-bca2-12569dafd572 req-b00f60ea-cd0c-417d-bc7b-ebe9e8ae238f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e6e532-d3bb-4834-a859-267ec293ca63", "tag": "2a59fae0-5f91-405f-92d7-106ecf9dd283"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:06.703381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a09367cc-8576-41ce-bca2-12569dafd572 req-b00f60ea-cd0c-417d-bc7b-ebe9e8ae238f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:09:06.703827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a09367cc-8576-41ce-bca2-12569dafd572 req-b00f60ea-cd0c-417d-bc7b-ebe9e8ae238f service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:09:06.718154 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-a09367cc-8576-41ce-bca2-12569dafd572 req-b00f60ea-cd0c-417d-bc7b-ebe9e8ae238f service nova] Creating event network-changed:2a59fae0-5f91-405f-92d7-106ecf9dd283 for instance 41e6e532-d3bb-4834-a859-267ec293ca63 on hv-cinder-86327 Nov 02 13:09:06.723760 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-a09367cc-8576-41ce-bca2-12569dafd572 req-b00f60ea-cd0c-417d-bc7b-ebe9e8ae238f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033529 Nov 02 13:09:06.724436 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 612/1246] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:22.515042 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:09:22.515769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:09:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:10:11.937159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:11.937805 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:11.944987 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:11.945432 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:11.946408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:11.946934 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:11.970815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lazy-loading 'flavor' on Instance uuid 606f86c3-9fe0-4271-b2b9-28fa23832a71 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:10:12.058620 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-654c8fb4-0d7f-422a-ba71-fd560e20f45b tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "POST /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71/action" status: 202 len: 0 microversion: 2.1 time: 0.126747 Nov 02 13:10:12.059249 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 635/1247] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 13:10:11 2022] POST /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:10:12.071582 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:12.072433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:12.079680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:12.080169 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:12.081071 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:12.081630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:12.239002 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:12.248063 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c50a6d9a-227b-4d9d-a0cc-1cce86e54f96 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.183398 Nov 02 13:10:12.248711 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 613/1248] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:12 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:13.276542 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:13.277191 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:13.284291 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:13.284744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:13.285522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:13.285953 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:13.434797 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:13.442937 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eed827c8-9316-4424-b7d3-691cc533d408 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.171541 Nov 02 13:10:13.443551 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 636/1249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:13 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:14.475972 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:14.476682 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:14.483550 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:14.483995 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:14.484813 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:14.485206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:14.637183 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:14.645083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0e169daa-3425-4c49-8dc9-58de0bd49ebc tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.182096 Nov 02 13:10:14.645659 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 614/1250] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:14 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:15.668951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:15.669681 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:15.676667 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:15.677101 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:15.677892 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:15.678326 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:15.824616 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:15.832669 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fb541302-9890-44b3-96ce-acc3867e01bf tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.167650 Nov 02 13:10:15.833249 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 637/1251] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:15 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:16.858418 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:16.859440 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:16.869431 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:16.870076 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:16.871405 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:16.872105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:17.029654 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:17.040010 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d3707cf0-17aa-43d2-aba5-5dfc21d08787 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.187452 Nov 02 13:10:17.040645 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 615/1252] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:16 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:18.064657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:18.065342 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:18.072779 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:18.073226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:18.074012 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:18.074457 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:18.240064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:18.249498 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4f577d80-416c-43c6-8812-78e5beb71841 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.188964 Nov 02 13:10:18.250099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 638/1253] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:18 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:19.275622 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:19.276269 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:19.286601 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:19.287043 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:19.287933 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:19.288387 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:19.450126 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:19.458155 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-052b4f12-caf0-4c62-9433-c41c98f79740 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.188258 Nov 02 13:10:19.458761 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 616/1254] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:19 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:20.487444 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:20.488043 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:20.495435 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:20.495878 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:20.496702 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:20.497134 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:20.657339 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:20.665625 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9a1020c6-cf65-44e7-8812-c735a0a4cdf7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.183511 Nov 02 13:10:20.666203 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 639/1255] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:20 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:21.690055 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:21.690810 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:21.697842 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:21.698472 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:21.699374 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:21.699804 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:21.854887 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:21.863239 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ca033d4e-4f13-412b-803d-8b0b85fcdfb8 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.177302 Nov 02 13:10:21.863857 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 617/1256] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:21 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:22.008376 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d16ecf08-a0d8-4110-b365-5237936d6f27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:22.009075 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d16ecf08-a0d8-4110-b365-5237936d6f27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:22.015683 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d16ecf08-a0d8-4110-b365-5237936d6f27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:22.016129 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d16ecf08-a0d8-4110-b365-5237936d6f27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:22.016940 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d16ecf08-a0d8-4110-b365-5237936d6f27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:22.017370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d16ecf08-a0d8-4110-b365-5237936d6f27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:22.044464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d16ecf08-a0d8-4110-b365-5237936d6f27 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/ips" status: 200 len: 150 microversion: 2.1 time: 0.103237 Nov 02 13:10:22.045055 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 640/1257] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 13:10:21 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:22.888452 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:22.889256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:22.896519 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:22.896981 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:22.897781 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:22.898256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:23.053634 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:23.061826 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-94a69fc7-b0fb-4d39-b967-7486acd80e1a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.177782 Nov 02 13:10:23.062394 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 618/1258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:22 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:23.416366 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d9e6cfb-002e-485c-82d1-b536b3db67b5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e237160-800f-41ba-b300-bd6090b0ba17"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:23.417509 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0d9e6cfb-002e-485c-82d1-b536b3db67b5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:23.424543 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d9e6cfb-002e-485c-82d1-b536b3db67b5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:23.425140 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d9e6cfb-002e-485c-82d1-b536b3db67b5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:23.425920 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d9e6cfb-002e-485c-82d1-b536b3db67b5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:23.426388 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d9e6cfb-002e-485c-82d1-b536b3db67b5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:23.727334 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0d9e6cfb-002e-485c-82d1-b536b3db67b5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314971 Nov 02 13:10:23.727980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 641/1259] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:10:23 2022] POST /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:24.086850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:24.087462 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:24.094418 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:24.094866 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:24.095679 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:24.096160 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:24.255971 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:24.264636 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d78e6c17-c2aa-418a-835b-a291dbedb744 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.182355 Nov 02 13:10:24.265209 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 619/1260] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:24 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:25.290536 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:25.292512 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:25.301259 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:25.301786 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:25.302591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:25.303037 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:25.458126 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:25.466475 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b06858fa-4ec5-4536-ab92-75f363e55227 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1567 microversion: 2.1 time: 0.181643 Nov 02 13:10:25.467093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 642/1261] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:25 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:25.492984 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1bf8b8c5-31c2-47ff-8ba6-7da3f666dcb9 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:25.493951 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1bf8b8c5-31c2-47ff-8ba6-7da3f666dcb9 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:25.502470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bf8b8c5-31c2-47ff-8ba6-7da3f666dcb9 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:25.502929 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bf8b8c5-31c2-47ff-8ba6-7da3f666dcb9 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:25.503756 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bf8b8c5-31c2-47ff-8ba6-7da3f666dcb9 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:25.504446 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1bf8b8c5-31c2-47ff-8ba6-7da3f666dcb9 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:25.611239 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1bf8b8c5-31c2-47ff-8ba6-7da3f666dcb9 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "POST /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71/action" status: 202 len: 0 microversion: 2.1 time: 0.123674 Nov 02 13:10:25.611853 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 620/1262] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Nov 2 13:10:25 2022] POST /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:10:25.620771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:25.621402 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:25.627810 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:25.628632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:25.629653 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:25.630588 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:25.799622 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:25.808148 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-84ab3200-fc41-457a-a907-145348d7c93c tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1575 microversion: 2.1 time: 0.191401 Nov 02 13:10:25.808772 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 643/1263] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:25 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:25.998016 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e237160-800f-41ba-b300-bd6090b0ba17"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:25.999013 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:26.012480 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.012935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.013732 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.014311 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.127174 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Invalid volume: volume 1e237160-800f-41ba-b300-bd6090b0ba17 is already attached to instances: 41e6e532-d3bb-4834-a859-267ec293ca63 Nov 02 13:10:26.127875 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 400 to user: Invalid volume: volume 1e237160-800f-41ba-b300-bd6090b0ba17 is already attached to instances: 41e6e532-d3bb-4834-a859-267ec293ca63 {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:10:26.129034 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9fee6972-9231-4320-8501-fbbb61639423 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135136 Nov 02 13:10:26.129640 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 621/1264] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:10:25 2022] POST /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:10:26.211438 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:26.211962 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:26.218983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.219527 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.220433 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.220873 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.310707 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lazy-loading 'services' on Instance uuid 41e6e532-d3bb-4834-a859-267ec293ca63 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:10:26.397041 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0ac6b66b-8120-48a0-9bc8-3458221f8c50 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments/1e237160-800f-41ba-b300-bd6090b0ba17" status: 202 len: 0 microversion: 2.1 time: 0.193045 Nov 02 13:10:26.398058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 644/1265] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:10:26 2022] DELETE /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments/1e237160-800f-41ba-b300-bd6090b0ba17 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:10:26.406528 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-66183181-196d-4547-8c99-bdf4b55d3809 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:26.407878 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-66183181-196d-4547-8c99-bdf4b55d3809 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:26.422680 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66183181-196d-4547-8c99-bdf4b55d3809 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.423166 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66183181-196d-4547-8c99-bdf4b55d3809 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.423922 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66183181-196d-4547-8c99-bdf4b55d3809 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.424417 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66183181-196d-4547-8c99-bdf4b55d3809 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.464043 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-66183181-196d-4547-8c99-bdf4b55d3809 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061460 Nov 02 13:10:26.464666 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 622/1266] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:10:26 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:26.842982 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:26.843591 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:26.851126 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.851421 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.852196 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:26.852657 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:26.999753 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:27.008295 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8ad2ed52-71be-46d6-9cd7-ca4f0f75eff7 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1517 microversion: 2.1 time: 0.169808 Nov 02 13:10:27.008950 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 645/1267] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:26 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:27.479012 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-af086eed-20e8-41c3-939a-947b71152447 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:27.479969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-af086eed-20e8-41c3-939a-947b71152447 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:27.487457 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-af086eed-20e8-41c3-939a-947b71152447 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:27.487911 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-af086eed-20e8-41c3-939a-947b71152447 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:27.488876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-af086eed-20e8-41c3-939a-947b71152447 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:27.489343 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-af086eed-20e8-41c3-939a-947b71152447 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:27.523111 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-af086eed-20e8-41c3-939a-947b71152447 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048547 Nov 02 13:10:27.523717 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 623/1268] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:10:27 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:28.034046 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:28.035154 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:28.042580 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.043160 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.044081 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.044723 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.196044 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:28.203915 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-40d13015-6a72-4d39-bcd7-3e8b0e93168d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.174129 Nov 02 13:10:28.204522 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 646/1269] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:28 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:28.541123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c8b0e902-76cf-4f13-8898-a36dce272b7e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:28.542440 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c8b0e902-76cf-4f13-8898-a36dce272b7e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:28.552661 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8b0e902-76cf-4f13-8898-a36dce272b7e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.553116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8b0e902-76cf-4f13-8898-a36dce272b7e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.553902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8b0e902-76cf-4f13-8898-a36dce272b7e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.554426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c8b0e902-76cf-4f13-8898-a36dce272b7e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.587098 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c8b0e902-76cf-4f13-8898-a36dce272b7e tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052279 Nov 02 13:10:28.587568 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 624/1270] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:10:28 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:10:28.662643 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:28.663233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:28.671304 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.671786 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.672663 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.673155 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.700112 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:10:28.787064 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-22787085-6258-4d75-82a8-ca34976beae8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 204 len: 0 microversion: 2.1 time: 0.129070 Nov 02 13:10:28.791661 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 647/1271] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:10:28 2022] DELETE /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:10:28.798020 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:28.798580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:28.804986 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.805513 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.806426 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:28.806855 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:28.964857 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:28.972692 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-334c0e37-80a3-482a-b541-97460588d77f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1682 microversion: 2.1 time: 0.179537 Nov 02 13:10:28.973482 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 625/1272] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:28 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:28.995973 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-ebc93857-d977-45da-befa-d4e3174d8729 req-5818722c-bacd-49f7-9770-44a14dbb9a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606f86c3-9fe0-4271-b2b9-28fa23832a71", "name": "network-vif-unplugged", "status": "completed", "tag": "9ff7f99c-5f23-4304-90e6-678baee4ab6a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:29.005066 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ebc93857-d977-45da-befa-d4e3174d8729 req-5818722c-bacd-49f7-9770-44a14dbb9a91 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:29.005423 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ebc93857-d977-45da-befa-d4e3174d8729 req-5818722c-bacd-49f7-9770-44a14dbb9a91 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:29.017357 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-ebc93857-d977-45da-befa-d4e3174d8729 req-5818722c-bacd-49f7-9770-44a14dbb9a91 service nova] Creating event network-vif-unplugged:9ff7f99c-5f23-4304-90e6-678baee4ab6a for instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 on hv-cinder-86327 Nov 02 13:10:29.022336 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-ebc93857-d977-45da-befa-d4e3174d8729 req-5818722c-bacd-49f7-9770-44a14dbb9a91 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030446 Nov 02 13:10:29.023184 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 648/1273] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:29.229338 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:29.229944 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:29.236672 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:29.237123 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:29.237889 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:29.238306 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:29.399179 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:29.408516 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d7c976a3-697f-4539-bfd4-6aadc2f36e47 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.183249 Nov 02 13:10:29.409087 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 626/1274] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:29 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:29.998901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:29.999614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:30.006564 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:30.007009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:30.007783 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:30.008226 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:30.163154 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:30.174682 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1a2b2abe-4e10-4220-b751-bf5a792cf41a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1682 microversion: 2.1 time: 0.180473 Nov 02 13:10:30.179706 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 649/1275] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:29 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:30.436058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:30.436696 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:30.443483 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:30.443674 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:30.444518 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:30.444919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:30.593863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:30.605188 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-01177f9f-7c15-4701-9c8f-86dc7f04b513 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.173227 Nov 02 13:10:30.605870 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 627/1276] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:30 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:31.198672 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:31.199277 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:31.206011 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:31.206455 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:31.207245 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:31.207684 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:31.346341 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:31.354408 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9370a505-8e6a-4117-8c79-7c00c502bc8d tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1682 microversion: 2.1 time: 0.159751 Nov 02 13:10:31.354990 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 650/1277] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:31 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:31.636712 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:31.637334 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:31.645443 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:31.645863 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:31.647107 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:31.647549 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:31.874992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:31.883552 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-226ed4de-7964-4609-b12b-d99dc296176a tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.252703 Nov 02 13:10:31.884102 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 628/1278] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:31 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:32.031464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-ce989521-993c-4464-8d5d-cc8a8569d296 req-d7335ca2-849f-4bd1-b2a6-4247cfb9ac8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e6e532-d3bb-4834-a859-267ec293ca63", "name": "network-vif-deleted", "tag": "2a59fae0-5f91-405f-92d7-106ecf9dd283"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:32.042841 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ce989521-993c-4464-8d5d-cc8a8569d296 req-d7335ca2-849f-4bd1-b2a6-4247cfb9ac8b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:32.043748 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ce989521-993c-4464-8d5d-cc8a8569d296 req-d7335ca2-849f-4bd1-b2a6-4247cfb9ac8b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:32.061441 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-ce989521-993c-4464-8d5d-cc8a8569d296 req-d7335ca2-849f-4bd1-b2a6-4247cfb9ac8b service nova] Creating event network-vif-deleted:2a59fae0-5f91-405f-92d7-106ecf9dd283 for instance 41e6e532-d3bb-4834-a859-267ec293ca63 on hv-cinder-86327 Nov 02 13:10:32.067524 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-ce989521-993c-4464-8d5d-cc8a8569d296 req-d7335ca2-849f-4bd1-b2a6-4247cfb9ac8b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041564 Nov 02 13:10:32.068890 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 651/1279] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:32.380238 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:32.380745 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:32.387691 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:32.388161 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:32.389012 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:32.389542 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:32.424873 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:32.425369 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:32.425822 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lazy-loading 'fault' on Instance uuid 41e6e532-d3bb-4834-a859-267ec293ca63 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:10:32.476293 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:32.486655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0b5132a0-c29c-4659-bbfb-df7c0ce69898 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 200 len: 1331 microversion: 2.1 time: 0.111641 Nov 02 13:10:32.487329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 629/1280] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:32 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:32.907815 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:32.909411 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:32.916790 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:32.917233 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:32.918082 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:32.918843 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:33.078157 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:33.087286 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-211f2be6-71d2-4024-9764-f16553070049 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.183760 Nov 02 13:10:33.087921 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 652/1281] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:32 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:33.514643 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:33.515766 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:33.523470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:33.523919 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:33.524901 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:33.525342 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:33.539363 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance 41e6e532-d3bb-4834-a859-267ec293ca63 could not be found. Nov 02 13:10:33.539961 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance 41e6e532-d3bb-4834-a859-267ec293ca63 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:10:33.540827 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-946c662d-b146-4834-8d1c-3037a57b6fd9 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 404 len: 111 microversion: 2.1 time: 0.033022 Nov 02 13:10:33.541372 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 630/1282] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:33 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:10:33.550068 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9304fe1f-61c9-4ecf-bea9-0c10bd1cecd4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '.version_select at 0x7fbe41fbab80>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:33.571525 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9304fe1f-61c9-4ecf-bea9-0c10bd1cecd4 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111172442" status: 202 len: 0 microversion: 2.1 time: 0.025211 Nov 02 13:10:33.572120 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 653/1283] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Nov 2 13:10:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111172442 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:10:34.110848 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:34.111463 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:34.119178 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:34.119876 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:34.121195 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:34.121968 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:34.301998 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5ce04c82-f9ea-4e65-8035-0a79047e7bd3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: .version_select at 0x7fbe41e93ee0>, body: {"keypair": {"name": "tempest-keypair-9865854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIZStjRNPoSrffcstErLXYr01ptZrXOHrFMdEURRnOpJ/P2508CPIUjXvT5hAE5bb5YsJKZ3N26LUous2HqVQsLLcxqsMWn4jn+/aCpuwOqBSdA/kgmpV3ichMvESMeVQ=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:34.321891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-5ce04c82-f9ea-4e65-8035-0a79047e7bd3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:10:34.326792 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-5ce04c82-f9ea-4e65-8035-0a79047e7bd3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:10:34.347274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:34.353168 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5ce04c82-f9ea-4e65-8035-0a79047e7bd3 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.055924 Nov 02 13:10:34.354025 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 654/1284] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Nov 2 13:10:34 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:34.359433 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f272c9f2-18c3-4553-8316-a448ac5d3eba tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.252502 Nov 02 13:10:34.360116 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 631/1285] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:34 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:35.385817 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:35.386540 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:35.393009 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:35.393465 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:35.394362 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:35.394798 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:35.628664 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:35.637099 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2f060213-0521-4b0a-81d7-0bd20e8d8903 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.257272 Nov 02 13:10:35.637775 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 655/1286] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:35 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:35.774082 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1416305024", "imageRef": "976691b9-291e-4b3f-9709-df427707e495", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46222446-e421-4f44-b970-f0c2d05a9631"}], "security_groups": [{"name": "tempest-securitygroup--1891602147"}], "key_name": "tempest-keypair-9865854", "user_data": "}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:35.880344 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] validate_networks() for [('46222446-e421-4f44-b970-f0c2d05a9631', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Nov 02 13:10:36.559231 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:10:36.559648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:10:36.560099 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:10:36.560557 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:10:36.560992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:10:36.570532 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:36.570998 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:36.571794 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:36.572255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:36.590466 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:10:36.594805 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Getting quotas for user 6c571f8eb3fc4943b2316de141d624c8 and project 19aa22fb93224586a50c7447a5310ecd. Resources: {'ram', 'cores', 'instances'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:10:36.606748 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Nov 02 13:10:36.609083 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='976691b9-291e-4b3f-9709-df427707e495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Nov 02 13:10:36.660121 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f5707229-f7a0-4738-9b2d-424d10261899 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.890601 Nov 02 13:10:36.661118 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 632/1287] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Nov 2 13:10:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:10:36.665529 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:36.666636 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:36.673470 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-74f9aa53-4044-4a30-8c58-f38bd86db14b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:36.674044 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-74f9aa53-4044-4a30-8c58-f38bd86db14b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:36.677216 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:36.678510 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:36.679490 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:36.680028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:36.743747 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-74f9aa53-4044-4a30-8c58-f38bd86db14b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:36.751634 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-74f9aa53-4044-4a30-8c58-f38bd86db14b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1239 microversion: 2.1 time: 0.082796 Nov 02 13:10:36.753685 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 633/1288] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:36 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:36.863249 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:36.874188 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5b5d4222-a37a-45ed-95cc-e602987ce908 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1573 microversion: 2.1 time: 0.214683 Nov 02 13:10:36.876032 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 656/1289] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:36 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1573 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:37.778346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:37.779580 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:37.788492 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:37.788957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:37.789753 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:37.790198 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:37.894058 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:37.899466 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:37.900071 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:37.904823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fdb8dbe4-49d6-444d-b922-5a65237c3407 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1299 microversion: 2.1 time: 0.131165 Nov 02 13:10:37.905625 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 634/1290] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:37 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:37.908096 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:37.908590 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:37.909400 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:37.909828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:38.066876 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:38.074629 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9923d776-c25a-42e6-b355-c4a43ce8c115 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1560 microversion: 2.1 time: 0.179106 Nov 02 13:10:38.075296 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 657/1291] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:37 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:38.930175 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:38.930782 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:38.937708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:38.938554 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:38.939584 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:38.940259 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:39.097145 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-01c5b145-250a-4b42-95c0-0fd7ca22cdda req-590babd6-fd97-4443-86fc-1af49e520b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606f86c3-9fe0-4271-b2b9-28fa23832a71", "name": "network-vif-plugged", "status": "completed", "tag": "9ff7f99c-5f23-4304-90e6-678baee4ab6a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:39.107277 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-01c5b145-250a-4b42-95c0-0fd7ca22cdda req-590babd6-fd97-4443-86fc-1af49e520b6c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:39.107467 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-01c5b145-250a-4b42-95c0-0fd7ca22cdda req-590babd6-fd97-4443-86fc-1af49e520b6c service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:39.119648 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-01c5b145-250a-4b42-95c0-0fd7ca22cdda req-590babd6-fd97-4443-86fc-1af49e520b6c service nova] Creating event network-vif-plugged:9ff7f99c-5f23-4304-90e6-678baee4ab6a for instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 on hv-cinder-86327 Nov 02 13:10:39.125017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-01c5b145-250a-4b42-95c0-0fd7ca22cdda req-590babd6-fd97-4443-86fc-1af49e520b6c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Nov 02 13:10:39.125597 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 658/1292] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:10:39.213329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:39.221635 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cf5617eb-8e53-41ef-8d7b-d8b000fef39f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1365 microversion: 2.1 time: 0.295630 Nov 02 13:10:39.222222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 635/1293] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:38 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:39.335829 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-9c5f1aa7-378b-4ac3-9795-ae8ce699e8bd req-cd7703ac-16f1-4ad2-b86b-31fc56753e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bd6b86-c91b-46a0-8798-4470d1b56d3e", "tag": "7b41adc0-1ce9-4ac6-97fe-ede096896910"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:39.351374 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9c5f1aa7-378b-4ac3-9795-ae8ce699e8bd req-cd7703ac-16f1-4ad2-b86b-31fc56753e94 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:39.352965 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9c5f1aa7-378b-4ac3-9795-ae8ce699e8bd req-cd7703ac-16f1-4ad2-b86b-31fc56753e94 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:39.371818 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-9c5f1aa7-378b-4ac3-9795-ae8ce699e8bd req-cd7703ac-16f1-4ad2-b86b-31fc56753e94 service nova] Creating event network-changed:7b41adc0-1ce9-4ac6-97fe-ede096896910 for instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e on hv-cinder-86327 Nov 02 13:10:39.377775 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-9c5f1aa7-378b-4ac3-9795-ae8ce699e8bd req-cd7703ac-16f1-4ad2-b86b-31fc56753e94 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047856 Nov 02 13:10:39.378394 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 659/1294] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:10:40.247018 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:40.247731 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:40.254410 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:40.255216 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:40.256050 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:40.256639 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:40.499802 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:40.508619 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e3d22b01-ea26-478e-aa17-c860580fbcb5 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1365 microversion: 2.1 time: 0.266263 Nov 02 13:10:40.509339 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 636/1295] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:40 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:41.539558 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:41.540273 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:41.547518 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:41.547947 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:41.548790 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:41.549232 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:41.702159 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:41.710497 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f3a38c2f-7131-4d67-bc8d-a0a609b770f8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1365 microversion: 2.1 time: 0.175326 Nov 02 13:10:41.711093 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 660/1296] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:41 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:42.735326 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:42.735952 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:42.743553 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:42.744389 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:42.745222 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:42.745648 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:42.909020 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:42.917453 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-086b5bee-6729-4dd2-aa4c-c8e35b84c046 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1365 microversion: 2.1 time: 0.186146 Nov 02 13:10:42.918241 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 637/1297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:42 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:43.943331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:43.944163 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:43.951257 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:43.951698 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:43.952494 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:43.952921 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:44.111891 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:44.120337 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-67c88969-3115-4aae-b09a-b17e33410feb tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1365 microversion: 2.1 time: 0.180875 Nov 02 13:10:44.120927 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 661/1298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:43 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:45.119857 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-ee10e77b-55f7-43ff-83e1-dc9613d93862 req-f5a73be1-506a-4b14-965b-dd3e3fbe8b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bd6b86-c91b-46a0-8798-4470d1b56d3e", "name": "network-vif-plugged", "status": "completed", "tag": "7b41adc0-1ce9-4ac6-97fe-ede096896910"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:45.128456 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-ee10e77b-55f7-43ff-83e1-dc9613d93862 req-f5a73be1-506a-4b14-965b-dd3e3fbe8b59 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:45.128902 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-ee10e77b-55f7-43ff-83e1-dc9613d93862 req-f5a73be1-506a-4b14-965b-dd3e3fbe8b59 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:45.140937 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-ee10e77b-55f7-43ff-83e1-dc9613d93862 req-f5a73be1-506a-4b14-965b-dd3e3fbe8b59 service nova] Creating event network-vif-plugged:7b41adc0-1ce9-4ac6-97fe-ede096896910 for instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e on hv-cinder-86327 Nov 02 13:10:45.143161 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:45.143785 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:45.146335 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-ee10e77b-55f7-43ff-83e1-dc9613d93862 req-f5a73be1-506a-4b14-965b-dd3e3fbe8b59 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030646 Nov 02 13:10:45.147526 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 638/1299] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:45.151511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:45.152040 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:45.152968 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:45.153494 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:45.313812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:45.321442 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f61773da-47d2-48d8-b223-1b431441cbb2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1365 microversion: 2.1 time: 0.182176 Nov 02 13:10:45.322000 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 662/1300] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:45 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:46.345992 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:46.346710 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:46.353742 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:46.354193 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:46.354970 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:46.355399 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:46.501108 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:46.509324 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c96105ac-8b6c-489c-a154-eb3bb0b1162f tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1365 microversion: 2.1 time: 0.168081 Nov 02 13:10:46.509936 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 639/1301] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:46 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:47.533415 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:47.534028 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:47.541029 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:47.541520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:47.542297 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:47.542720 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:47.680812 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:47.688985 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-197f3bd1-37c6-4e3c-8b72-3d05429b395b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1555 microversion: 2.1 time: 0.159556 Nov 02 13:10:47.689581 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 663/1302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:47 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:47.712144 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9c7012d5-1166-4de2-9a7a-498fc7857f02 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:47.712729 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9c7012d5-1166-4de2-9a7a-498fc7857f02 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:10:47.719910 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c7012d5-1166-4de2-9a7a-498fc7857f02 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:47.720329 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c7012d5-1166-4de2-9a7a-498fc7857f02 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:47.721089 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c7012d5-1166-4de2-9a7a-498fc7857f02 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:47.721521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c7012d5-1166-4de2-9a7a-498fc7857f02 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:47.808901 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9c7012d5-1166-4de2-9a7a-498fc7857f02 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100825 Nov 02 13:10:47.809500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 640/1303] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Nov 2 13:10:47 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:48.745626 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-61d55ed8-56ae-4c6c-98fb-21db83e9254b req-56e1d79a-ffbe-4beb-8d63-ad983b8c42dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bd6b86-c91b-46a0-8798-4470d1b56d3e", "tag": "7b41adc0-1ce9-4ac6-97fe-ede096896910"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:48.755077 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-61d55ed8-56ae-4c6c-98fb-21db83e9254b req-56e1d79a-ffbe-4beb-8d63-ad983b8c42dd service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:10:48.755605 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-61d55ed8-56ae-4c6c-98fb-21db83e9254b req-56e1d79a-ffbe-4beb-8d63-ad983b8c42dd service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:10:48.767897 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-61d55ed8-56ae-4c6c-98fb-21db83e9254b req-56e1d79a-ffbe-4beb-8d63-ad983b8c42dd service nova] Creating event network-changed:7b41adc0-1ce9-4ac6-97fe-ede096896910 for instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e on hv-cinder-86327 Nov 02 13:10:48.773306 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-61d55ed8-56ae-4c6c-98fb-21db83e9254b req-56e1d79a-ffbe-4beb-8d63-ad983b8c42dd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031545 Nov 02 13:10:48.774138 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 664/1304] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:06.887907 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5ac5d40e-83f0-4e67-a312-a7addc77c0e2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:06.888573 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5ac5d40e-83f0-4e67-a312-a7addc77c0e2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:06.897521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ac5d40e-83f0-4e67-a312-a7addc77c0e2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:06.898095 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ac5d40e-83f0-4e67-a312-a7addc77c0e2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:06.899197 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ac5d40e-83f0-4e67-a312-a7addc77c0e2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:06.899769 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ac5d40e-83f0-4e67-a312-a7addc77c0e2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:06.925074 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5ac5d40e-83f0-4e67-a312-a7addc77c0e2 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/ips" status: 200 len: 150 microversion: 2.1 time: 0.044585 Nov 02 13:12:06.925650 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 641/1305] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Nov 2 13:12:06 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:08.297625 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-49ac3ee0-ea96-475d-b1ef-cd3786762d49 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e59f5fa4-f2ea-4127-a340-b108beebac8b"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:08.299146 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-49ac3ee0-ea96-475d-b1ef-cd3786762d49 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:08.307983 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49ac3ee0-ea96-475d-b1ef-cd3786762d49 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:08.308632 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49ac3ee0-ea96-475d-b1ef-cd3786762d49 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:08.309838 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49ac3ee0-ea96-475d-b1ef-cd3786762d49 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:08.310492 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49ac3ee0-ea96-475d-b1ef-cd3786762d49 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:08.607170 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-49ac3ee0-ea96-475d-b1ef-cd3786762d49 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "POST /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317036 Nov 02 13:12:08.607825 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 665/1306] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Nov 2 13:12:08 2022] POST /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:16.323750 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:16.324381 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:16.330614 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:16.331064 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:16.331836 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:16.332290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:16.419551 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lazy-loading 'services' on Instance uuid a3bd6b86-c91b-46a0-8798-4470d1b56d3e {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 02 13:12:16.502135 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-48fc1c79-0427-4845-8ee2-61284d249bf0 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments/e59f5fa4-f2ea-4127-a340-b108beebac8b" status: 202 len: 0 microversion: 2.1 time: 0.185056 Nov 02 13:12:16.502743 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 642/1307] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Nov 2 13:12:16 2022] DELETE /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments/e59f5fa4-f2ea-4127-a340-b108beebac8b => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:16.513075 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-828749fd-a5e0-4020-87b6-987121a4493b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:16.514077 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-828749fd-a5e0-4020-87b6-987121a4493b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:16.520520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-828749fd-a5e0-4020-87b6-987121a4493b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:16.521002 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-828749fd-a5e0-4020-87b6-987121a4493b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:16.521806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-828749fd-a5e0-4020-87b6-987121a4493b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:16.522235 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-828749fd-a5e0-4020-87b6-987121a4493b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:16.551922 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-828749fd-a5e0-4020-87b6-987121a4493b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Nov 02 13:12:16.552579 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 666/1308] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:12:16 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:17.567392 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9c01df17-9b73-4972-87fb-2ecb0fea2640 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:17.568675 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9c01df17-9b73-4972-87fb-2ecb0fea2640 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:17.575689 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c01df17-9b73-4972-87fb-2ecb0fea2640 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:17.576132 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c01df17-9b73-4972-87fb-2ecb0fea2640 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:17.577146 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c01df17-9b73-4972-87fb-2ecb0fea2640 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:17.577600 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c01df17-9b73-4972-87fb-2ecb0fea2640 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:17.611240 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9c01df17-9b73-4972-87fb-2ecb0fea2640 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049316 Nov 02 13:12:17.611791 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 643/1309] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Nov 2 13:12:17 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:12:17.685744 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:17.686361 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:17.693374 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:17.693828 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:17.694614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:17.695058 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:17.721568 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:12:17.807239 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bfd07ba6-a74d-48c4-810e-47caf2bf9125 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 204 len: 0 microversion: 2.1 time: 0.125502 Nov 02 13:12:17.807842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 667/1310] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:17 2022] DELETE /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:12:17.820521 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:17.821408 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:17.828655 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:17.829105 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:17.829879 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:17.830314 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:18.260346 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:18.268095 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6ae8ca8d-0b34-4822-8437-7917fec68d9b tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1680 microversion: 2.1 time: 0.455263 Nov 02 13:12:18.268850 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 644/1311] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:17 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1680 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:19.294124 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:19.294844 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:19.301842 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:19.302219 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:19.303020 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:19.303462 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:19.454582 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:19.462919 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-04710ed4-eb37-4f2c-ad8e-62ba112fcd46 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1680 microversion: 2.1 time: 0.173227 Nov 02 13:12:19.463520 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 668/1312] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:19 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:20.487469 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:20.488347 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:20.495290 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:20.495935 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:20.496836 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:20.497269 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:20.701883 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c571f8eb3fc4943b2316de141d624c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19aa22fb93224586a50c7447a5310ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:20.710681 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b5186540-0e79-4e18-80e3-942cde9aa28c tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 200 len: 1680 microversion: 2.1 time: 0.227308 Nov 02 13:12:20.724318 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 645/1313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:20 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:21.030238 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-9fa2b979-9d32-43e9-84cc-69c5bfb1a6f5 req-524e3ba0-50cf-47fa-aaae-a7cc175b881b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bd6b86-c91b-46a0-8798-4470d1b56d3e", "name": "network-vif-deleted", "tag": "7b41adc0-1ce9-4ac6-97fe-ede096896910"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:21.051850 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9fa2b979-9d32-43e9-84cc-69c5bfb1a6f5 req-524e3ba0-50cf-47fa-aaae-a7cc175b881b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:21.053494 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9fa2b979-9d32-43e9-84cc-69c5bfb1a6f5 req-524e3ba0-50cf-47fa-aaae-a7cc175b881b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:21.068257 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-9fa2b979-9d32-43e9-84cc-69c5bfb1a6f5 req-524e3ba0-50cf-47fa-aaae-a7cc175b881b service nova] Creating event network-vif-deleted:7b41adc0-1ce9-4ac6-97fe-ede096896910 for instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e on hv-cinder-86327 Nov 02 13:12:21.073806 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-9fa2b979-9d32-43e9-84cc-69c5bfb1a6f5 req-524e3ba0-50cf-47fa-aaae-a7cc175b881b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047817 Nov 02 13:12:21.074429 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 669/1314] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:21.735405 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:21.736019 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:21.743247 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:21.743844 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:21.745303 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:21.745303 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:21.760578 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e could not be found. Nov 02 13:12:21.761256 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:21.762135 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0df959fd-2abf-4045-b3b2-655d7c9e2a58 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 404 len: 111 microversion: 2.1 time: 0.030873 Nov 02 13:12:21.762706 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 646/1315] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:21 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:21.771951 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1cedf633-4fcc-417e-aff2-82f87c6a88c8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '.version_select at 0x7fbe420b3a60>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:21.792065 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1cedf633-4fcc-417e-aff2-82f87c6a88c8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-9865854" status: 202 len: 0 microversion: 2.1 time: 0.024337 Nov 02 13:12:21.793381 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 670/1316] 10.222.0.90 () {58 vars in 1212 bytes} [Wed Nov 2 13:12:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-9865854 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:23.143841 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:23.144701 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:23.151086 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:23.151837 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:23.152859 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:23.153515 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:23.185847 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Nov 02 13:12:23.208817 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-f7910eaa-907c-4254-aa56-6d8a2b6b3e8d req-7d7de9a4-7e5e-486a-aded-b9922c1322a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606f86c3-9fe0-4271-b2b9-28fa23832a71", "tag": "9ff7f99c-5f23-4304-90e6-678baee4ab6a"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:23.224835 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-f7910eaa-907c-4254-aa56-6d8a2b6b3e8d req-7d7de9a4-7e5e-486a-aded-b9922c1322a3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:23.226287 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-f7910eaa-907c-4254-aa56-6d8a2b6b3e8d req-7d7de9a4-7e5e-486a-aded-b9922c1322a3 service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:23.238707 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-f7910eaa-907c-4254-aa56-6d8a2b6b3e8d req-7d7de9a4-7e5e-486a-aded-b9922c1322a3 service nova] Creating event network-changed:9ff7f99c-5f23-4304-90e6-678baee4ab6a for instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 on hv-cinder-86327 Nov 02 13:12:23.245245 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-f7910eaa-907c-4254-aa56-6d8a2b6b3e8d req-7d7de9a4-7e5e-486a-aded-b9922c1322a3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105458 Nov 02 13:12:23.245977 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 647/1317] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:23.278751 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ad39a9c2-d474-4224-b44c-e5e67d0a19a5 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "DELETE /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 204 len: 0 microversion: 2.1 time: 0.139145 Nov 02 13:12:23.282489 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 671/1318] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:23 2022] DELETE /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:12:23.288420 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:23.289372 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:23.296262 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:23.296839 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:23.297714 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:23.298227 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:23.542630 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:23.550561 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1d931166-78b0-4046-99e3-04440914186d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1566 microversion: 2.1 time: 0.266510 Nov 02 13:12:23.551246 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 648/1319] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:23 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:24.110830 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:24.111426 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:24.118373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:24.118696 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:24.119532 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:24.119971 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:24.134773 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e could not be found. Nov 02 13:12:24.135373 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:24.136417 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4477fc21-a097-4c0d-995a-debe69694d15 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 404 len: 111 microversion: 2.1 time: 0.029989 Nov 02 13:12:24.136926 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 672/1320] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:24 2022] DELETE /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:12:24.145206 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:24.145805 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: a3bd6b86-c91b-46a0-8798-4470d1b56d3e] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:24.153056 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:24.153500 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:24.154280 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:24.154708 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:24.169816 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e could not be found. Nov 02 13:12:24.170412 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance a3bd6b86-c91b-46a0-8798-4470d1b56d3e could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:24.171248 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2157c243-78d0-4873-b862-c4b4ef5bc095 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e" status: 404 len: 111 microversion: 2.1 time: 0.029966 Nov 02 13:12:24.171809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 649/1321] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:24 2022] GET /compute/v2.1/servers/a3bd6b86-c91b-46a0-8798-4470d1b56d3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:24.576763 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:24.577385 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:24.583898 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:24.584384 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:24.585174 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:24.585610 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:24.740922 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:24.749880 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-255285e2-4bab-43a4-b28b-671186cbce0d tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1447 microversion: 2.1 time: 0.178919 Nov 02 13:12:24.750478 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 673/1322] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:24 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:25.316421 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:25.317004 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:25.323644 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.324095 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.324957 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.325494 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.340969 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance 41e6e532-d3bb-4834-a859-267ec293ca63 could not be found. Nov 02 13:12:25.341607 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance 41e6e532-d3bb-4834-a859-267ec293ca63 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:25.342448 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a671e4d5-b55c-4b8f-8550-8fffdfc0c546 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 404 len: 111 microversion: 2.1 time: 0.030177 Nov 02 13:12:25.343014 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 650/1323] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:25 2022] DELETE /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:25.351980 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:25.352943 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 41e6e532-d3bb-4834-a859-267ec293ca63] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:25.359296 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.359745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.360626 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.361057 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.375142 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance 41e6e532-d3bb-4834-a859-267ec293ca63 could not be found. Nov 02 13:12:25.375740 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance 41e6e532-d3bb-4834-a859-267ec293ca63 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:25.376605 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2f226f9a-cf70-45c9-b6fe-958a9ac03261 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63" status: 404 len: 111 microversion: 2.1 time: 0.029241 Nov 02 13:12:25.377401 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 674/1324] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:25 2022] GET /compute/v2.1/servers/41e6e532-d3bb-4834-a859-267ec293ca63 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:25.387229 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:25.387753 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:25.393851 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.394304 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.395077 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.395611 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.409306 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance 2c0c3e26-4375-4db6-b45b-813178cbdacd could not be found. Nov 02 13:12:25.409934 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance 2c0c3e26-4375-4db6-b45b-813178cbdacd could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:25.410809 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0bb40b3c-a617-4767-948b-a5c0c890cda8 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 404 len: 111 microversion: 2.1 time: 0.028636 Nov 02 13:12:25.411543 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 651/1325] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:25 2022] DELETE /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:25.420224 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:25.420855 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: 2c0c3e26-4375-4db6-b45b-813178cbdacd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:25.427370 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.427848 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.428745 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.429177 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.443206 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance 2c0c3e26-4375-4db6-b45b-813178cbdacd could not be found. Nov 02 13:12:25.443813 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance 2c0c3e26-4375-4db6-b45b-813178cbdacd could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:25.444695 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b23aaba6-02db-4aec-9281-46fff733b808 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd" status: 404 len: 111 microversion: 2.1 time: 0.028820 Nov 02 13:12:25.445252 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 675/1326] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:25 2022] GET /compute/v2.1/servers/2c0c3e26-4375-4db6-b45b-813178cbdacd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:12:25.774750 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:25.775598 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:25.785181 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.785600 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.786407 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.786832 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.816292 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-efc67b35-9635-4377-8ed3-1c0b05e13021 req-c0192985-6160-44e1-9da7-8ba0207edb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606f86c3-9fe0-4271-b2b9-28fa23832a71", "name": "network-vif-deleted", "tag": "9ff7f99c-5f23-4304-90e6-678baee4ab6a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:25.825614 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-efc67b35-9635-4377-8ed3-1c0b05e13021 req-c0192985-6160-44e1-9da7-8ba0207edb3b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:25.826151 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-efc67b35-9635-4377-8ed3-1c0b05e13021 req-c0192985-6160-44e1-9da7-8ba0207edb3b service nova] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:25.838731 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-efc67b35-9635-4377-8ed3-1c0b05e13021 req-c0192985-6160-44e1-9da7-8ba0207edb3b service nova] Creating event network-vif-deleted:9ff7f99c-5f23-4304-90e6-678baee4ab6a for instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 on hv-cinder-86327 Nov 02 13:12:25.846966 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-efc67b35-9635-4377-8ed3-1c0b05e13021 req-c0192985-6160-44e1-9da7-8ba0207edb3b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033985 Nov 02 13:12:25.848901 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 676/1327] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:25.869239 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0c145873843fa9cb970bba426cbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ac1778be064017858e588e9567fd27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:25.882219 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1112c505-5500-4ed5-a1fa-c1f447e92441 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 200 len: 1380 microversion: 2.1 time: 0.111887 Nov 02 13:12:25.882797 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 652/1328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:25 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 1380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:26.614436 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:26.615017 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:26.621861 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:26.622331 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:26.623229 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:26.623511 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:26.639746 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 could not be found. Nov 02 13:12:26.640530 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:26.641437 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f64433c9-f93d-47e7-b461-86e64a963ce7 tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 404 len: 111 microversion: 2.1 time: 0.031473 Nov 02 13:12:26.642006 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 677/1329] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:26 2022] DELETE /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:26.652157 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:26.652894 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] [instance: ca6f26a5-a573-4de6-8bfa-8d10d473bd43] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:26.659823 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:26.660340 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:26.661160 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:26.661626 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:26.676028 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] HTTP exception thrown: Instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 could not be found. Nov 02 13:12:26.676792 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] Returning 404 to user: Instance ca6f26a5-a573-4de6-8bfa-8d10d473bd43 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:26.678255 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-60ae9947-e23a-48d3-875f-fee75b05ac7a tempest-AttachVolumeNegativeTest-2094408433 tempest-AttachVolumeNegativeTest-2094408433-project] 10.222.0.90 "GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43" status: 404 len: 111 microversion: 2.1 time: 0.030385 Nov 02 13:12:26.678938 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 653/1330] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:26 2022] GET /compute/v2.1/servers/ca6f26a5-a573-4de6-8bfa-8d10d473bd43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:26.907343 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:26.908007 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] [instance: 606f86c3-9fe0-4271-b2b9-28fa23832a71] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2918}} Nov 02 13:12:26.915999 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:26.916563 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:26.917412 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 02 13:12:26.917917 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Lock "df971900-0a53-43b2-b0cc-1fe63c2db549" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 02 13:12:26.932228 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] HTTP exception thrown: Instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 could not be found. Nov 02 13:12:26.932836 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Returning 404 to user: Instance 606f86c3-9fe0-4271-b2b9-28fa23832a71 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 13:12:26.933668 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9fc27a6d-38f4-475e-9b16-3fb7d979c636 tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71" status: 404 len: 111 microversion: 2.1 time: 0.030481 Nov 02 13:12:26.934506 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 678/1331] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:26 2022] GET /compute/v2.1/servers/606f86c3-9fe0-4271-b2b9-28fa23832a71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:27.211355 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f22ef282-5808-4121-b734-8b70f3e3eb7e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] Calling method '.version_select at 0x7fbe429180d0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:27.244069 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f22ef282-5808-4121-b734-8b70f3e3eb7e tempest-TestShelveInstance-16275346 tempest-TestShelveInstance-16275346-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-334502367" status: 202 len: 0 microversion: 2.1 time: 0.036756 Nov 02 13:12:27.244704 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 654/1332] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Nov 2 13:12:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-334502367 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:29.552771 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:14:29.553686 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: Wed Nov 2 13:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:15:10.550015 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:15:10.550738 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:15:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:16:02.528545 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:16:02.529274 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:17:39.369944 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:17:39.369944 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:17:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:17:43.055808 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:17:43.056516 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: Wed Nov 2 13:17:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:17:49.564512 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:17:49.565456 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: Wed Nov 2 13:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:17:59.275464 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:17:59.276146 dv-cinder-863278-1-iscsi devstack@n-api.service[124277]: Wed Nov 2 13:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 13:18:30.562476 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:18:30.563388 dv-cinder-863278-1-iscsi devstack@n-api.service[124278]: Wed Nov 2 13:18:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!